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Preface 



The theory of Laplace transformation is an important part of the mathematical background 
required for engineers, physicists and mathematicians. Laplace transformation methods 
provide easy and effective techniques for solving many problems arising in various fields of 
science and engineering, especially for solving differential equations. What the Laplace 
transformation does in the field of differential equations, the z-transformation achieves for 
difference equations. The two theories are parallel and have many analogies. Laplace and z- 
transformations are also referred to as operational calculus, but this notion is also used in a 
more restricted sense to denote the operational calculus of Mikusinski. This book does not use 
the operational calculus of Mikusinski, whose approach is based on abstract algebra and is not 
readily accessible to engineers and scientists. 

The symbolic computation capability of Mathematica can now be used in favor of the Laplace 
and z-transformations. The first version of the Mathematica Package Laplace AndzTransforms 
developed by the author appeared ten years ago. The Package computes not only Laplace and 
z-transforms but also includes many routines from various domains of applications. Upon 
loading the Package, about one hundred and fifty new commands are added to the built-in 
commands of Mathematica. The code is placed in front of the already built-in code of Laplace 
and z-transformations of Mathematica so that built-in functions not covered by the Package 
remain available. The Package substantially enhances the Laplace and z-transformation 
facilities of Mathematica. 

The book is mainly designed for readers working in the field of applications. Thus the 
exposition does not emphasize sophisticated proofs. It can be used as a textbook or as a 
supplement to a current standard text in a formal course on Laplace transform and z-transform 
theory and their applications. The first two chapters are a straightforward introduction to 
Laplace and z-transformation without mentioning the Package. Thus readers who already 
know Laplace and z-transformation may omit the first two chapters and start with Chapters 3 
and 4, which introduce the Package and show how to make use of it. These two chapters have 
the nature of a manual. The next two chapters are written in a mixed style. They introduce 
subjects generally considered to be on a higher level, followed by the description of the 
Package commands that can be helpful for these advanced subjects. The Package is not only 
intended to overcome cumbersome computations by hand; the aim of the project was rather to 
extend the scope of the method of Laplace and z-transforms to problems that can no longer be 
computed by hand. Chapters 8, 9, and 10 illustrate the use of the Package on problems from 
the fields of electricity, mechanics and control engineering. Chapter 11 introduces Duhamel’s 
formulas, Green’s functions and the finite Fourier transforms. The last Chapter 12 explains 
several numerical procedures for numerically computing an inverse Laplace transform. The 
CD in the back cover of the book contains the Package and the reference guide with all 
commands of the Package. When working with the Package, you may need to consult this 
guide, given the complex structure of many commands. 

Chapter 1 introduces the ordinary or one-sided Laplace transform with its operational 
properties. Efros’ theorem (a generalization of the convolution property) merits perhaps special 
mention. It is rarely exposed in an elementary introduction and may be omitted during the first 
reading. Some important special functions are then introduced. The inverse Laplace transform 
is mainly applied to rational image functions and the complex inversion formula is just 
mentioned. Complex variable theory is not needed. It follows an introduction of the two-sided 
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Laplace transform. The theory of Laplace transformation and its applications need the Dirac 
impulse with its principal properties. These are introduced in a heuristic manner by taking 
advantage of the two-sided Laplace transform. The first chapter closes with the application of 
the Laplace transformation on linear ordinary differential equations. The concepts of stability 
and of transfer functions of linear time invariant systems are also introduced. Chapter 2 
parallels Chapter 1 for the z-transformation. The discrete Laplace transform of a sequence is 
introduced as well, and a short excursion to another transform, called the MacLaurin transform 
follows. Some relationships between the z-transform, the discrete Laplace transform, the 
Laplace transform and the MacLaurin transform are exhibited. They are followed by the 
application of the z-transform to solve difference and systems of difference equations. The z- 
transfer function and the stability of a discrete system are introduced. It is the author’s 
intention that the first two chapters make no use of and are not related to the Package. 

Chapter 3 introduces the Package Laplace AndzTransforms. It has a manual character and is 
the first chapter to begin with for a reader already familiar with the theory of Laplace 
transforms. The material covers the various elementary subjects treated in the first chapter and 
shows how the Package can be used to do the computations. A novice can study it in parallel 
with the first chapter. Chapter 4 parallels Chapter 3, but for the z-transformation. 

Chapter 5 on automatic control systems is inserted before the method of Laplace and z- 
transforms are extended to more advanced problems. Laplace and z-transforms are widely 
applied in linear control theory. The Laplace transformation is the principal mathematical tool 
for analog automatic linear control systems, while the z-transformation applies to sampled-data 
systems. It should be noted that the Laplace transformation is not only a useful tool for the 
more classical approach to automatic control via the concept of transfer functions, but it is as 
well for the more modem state-variables approach. This chapter is not intended for learning 
automatic control theory, but the various commands of the Package in this field are clearly 
explained and illustrated with examples. A control engineer will find in Chapters 1 to 5, 
together with Chapter 9, the relevant subjects for his or her domain. 

Chapter 6 carries on with the theory of Laplace transformation and deals with some more 
advanced subjects. The reader is now assumed to know some concepts of complex-variables 
theory. The complex inversion formula is introduced and the calculus of residues is applied to 
compute inverse Laplace transforms. There follows the technique of translating and deforming 
the vertical integration path in the complex inversion integral. Asymptotics, especially in 
connection with Laplace transformation, deserves a better understanding than it is now the case 
in the mathematical education of engineers and scientists. In many cases where it is hard or 
impossible to find a closed form expression for an inverse Laplace transform, it is still possible 
to compute an asymptotic expansion for the original, valid for large (or small) values of the 
time t. The computations can be cumbersome when done by hand, but the Package has 
routines to do it. The chapter closes with an exposition of anomalous systems of ordinary 
differential equations. The fact that an anomalous system of linear ordinary differential 
equations with given initial conditions has no solution in a strictly classical sense, is still 
widely ignored. The computed solutions will only satisfy all given initial conditions if certain 
compatibility conditions are satisfied. This may be considered a detail but, unfortunately, most 
systems of differential equations that model real physical systems are anomalous. 

Chapter 7 introduces the so-called advanced z-transform. In contrast to the ordinary z- 
transform, it acts on continuously varying time functions, and not on sequences as the ordinary 
z-transform does. The advanced z-transform is applied to sampled-data systems, when a more 
complete description is required. It can also be used to express in closed form the output of a 
stable linear system with a periodic input. Another application is to compute the solution of 
difference equations with a continuous variable. Next we learn how to obtain the ordinary or 
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the advanced z-transform from a Laplace image function. Computations involving advanced z- 
transforms by hand are often laborious. The Package helps to do most computations by the 
computer. 

Chapter 8 illustrates the use of the Package by computing the various solutions of the 
telegrapher partial differential equation of transmission lines in electricity. Examples of 
asymptotic expansions of the solution can be found here. Chapter 9 displays the Package by 
means of several classical control problems. Chapter 10 uses the Package to compute the 
solution of several boundary value problems in connection with the heat conduction or 
diffusion equation. Samples of problems of waves and vibrations in elastic solids follow. 

In Chapter 11, further techniques for solving partial differential equations with the method of 
Laplace transformation are presented. The formulas of Duhamel and Green are developed and 
the Finite Fourier Transform is introduced. 

The use of Laplace transformation often comprises a hard step: the inverse Laplace transform. 
In fact, a large part of the theory and a still larger part of the Package code is concerned with 
the computation of an inverse Laplace transform. A comprehensive table of correspondences is 
built into the Package. For many problems, a closed form expression or an infinite series 
solution for the original function can be obtained. Sometimes an asymptotic expansion of the 
solution gives a valuable partial answer. Despite of all these analytical tools, every so often the 
problem arises that one finds the Laplace transform of the solution, but one cannot analytically 
find its inverse. Numerical methods for the computation of an inverse Laplace transform can 
then be helpful. This is the topic of Chapter 12. Unfortunately, this is not a so-called well- 
posed numerical problem. The inverse Laplace transform is an unbounded operator which 
gives rise to a numerically ill-conditioned problem. Nevertheless, in the last forty years several 
numerical algorithms were developed, which for many problems gives astonishingly good 
results; for others, they may fail. Chapter 12 presents several of these procedures with a short 
description. The intention is to give just an idea of how the algorithm works. 

There is no software without bugs. The software LaplaceAndzTransforms on the CD 
delivered with the book, and which has absorbed a far bigger part of work and effort than the 
book itself, makes no exception. Therefore, please note the Disclaimer below. The author 
would appreciate it if bugs or other suggestions about the Package are conveyed to him at the 
e-mail address below. The internet site below gives information on future versions of the 
Package. 

I wish to thank 

■ Wolfram Research for the generous invitation as an Invited Scholar during fall 2002 
in Urbana Champaign and the valuable support that I received there during those 
weeks, 

■ The University of Applied Science of Bern, Switzerland, which made possible this 
book by generously granting me a sabbatical leave, 

■ Dr. Baoswan Dzung Wong who helped me to improve the English text of the book. 
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Users should recognize that all complex software systems and their documentation contain 
errors and omissions. The author Urs E. Graf shall not be responsible under any circumstances 
for errors and omissions in this book or in the software LaplaceAndzTransforms delivered on 
the CD with this book, nor for any damages that they may entail. It is impossible to guarantee 
that this software is bug-free. The software is not only highly complex but it may also be 
misused if the user’s mathematical background is insufficient. 
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Chapter 1 

Laplace Transformation 

1.1 The One-Sided Laplace Transform 



■ 1.1.1 Definition and Elementary Properties 

Let fit) be a real or complex- valued function defined on the positive part 1R+ of the real axis. 
The Laplace transform of f{t) is defined as the function F(s) 

F(S) := e-“ f(t)dt, (1.1) 



provided that the integral exists. We also say, fit) is the original function or for short the 
original and F(s) is its image function or its image. For a given image function F(s), we call 
fit) the inverse Laplace transform of F(s ) . It is not necessary but we prefer to extend always 
the domain of an original function fit) to the left by defining fit) = 0 for t < 0. 



f (t) 




Thus, an original function is a complex-valued function of a real variable vanishing on the 
negative part of the real axis. The graph of a typical original function is shown in Fig. 1.1. 



A simple but important example of an original is the unit-step function or the Heaviside 
function uit ) . It is defined as 



u(t) := { 



0 , 

1 , 



t <0 
f > 0. 



The shifted unit-step uit - a) is the original that vanishes for t < a and takes on the value 1 for 
t > a . The shift a is assumed to be positive. We obtain this shifted unit-step function by 
translating the graph of uit) by a units to the right. Let us now compute the Laplace transform 
of the unit-step function: 
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X 



oo 



1 dt 





s 



provided that s > 0, or that the real part Rs of s is positive, if s varies over the complex plane. 
A pair of an original function and its image function is called a correspondence, denoted by 
f(t ) D - ■ F(s) . Thus we have just established the correspondence 



u(t)° 



1 

s 



As a second example, let us compute the Laplace transform of the shifted unit-step function 
u(t - a ) : 



r r°° ( e~ st \ 00 

e~ st u(t - a)dt = I e~ st dt=\ 1 =0 

Ja ' ~ ^ 't = a 

provided that Rs > 0. Thus the correspondence is given by 



-sa „-s a 



u(t -a) i 



The Laplace transform of the original function f(t) = u(t) sin cot is 



r ( e~ st °° co 

e~ st sin cot dt = — - t- (s sin cot - o;cosa>0 = — : — , 

\co 2 +s 2 J t = 0 co 2 + s 2 



provided that Rj > 0. We have established the correspondence 

co 



sin co t ° — i 



CO 2 + s 2 

For the original function f(t) = u(t) e at , we find 



F(s) 



r r°° ( \^°° 

e~ st e at dt= I e- (s - a)t dt = \ 

Jo V ~( s — a) ) t = Q 



1 



s-a 



provided that R(^ - a) > 0,i.e. R^ > R«. Thus we have the correspondence 



e 



1 



s-a 



We have made use of two conventions: First, we have not written the factor u(t) on the left- 
hand side of the last correspondences, second, we have not restricted the corresponding image 
function to Rs > 0 or Rs > Ra. Thus, when in the following we speak of the originals 
sin cot, t , f 1 , e at , ... we in fact always mean u(t) sin cot, u(t)t , u{t)f , u(t)e at , ... but we 
omit the factor u(t ) which has the effect that the expression in consideration is replaced by 0 
for negative values of t. Due to this convention the originals u(t ) and 1 are the same, the unit- 
step function. The reason for the second convention is that the domain of an image function, if 
it exists, is always a right half-plane of € of the form Rs > jto • The real number jco is called the 
abscissa of convergence of the Laplace integral (1.1). Thus, the first three examples above 
have the abscissa of convergence xo = 0, while in the fourth example xq - a. For the 
unilateral or one-sided Laplace transformation, we seldom have to worry about the abscissa of 
convergence. 
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For most functions encountered in applications a Laplace transform exists. We can make the 
following statement: 

Proposition. If the original f{t) satisfies \ fit) | < M e ct for t> 0, for some real number c 
and some positive number M, then the abscissa of convergence is smaller than or equal to c, 
i.e. the image function Fis) of fit) is defined on the right half-plane Rs > c. 



| r*oo s>oo | r*oo 

- e~ s> fit)dt <F(s):= e^' f{t)dt <\ \ e~ s ' f(t)dt 

I Jo Jo I Jo 



This is seen as follows 

1 fit) dt 
If Rs > c, we can write 

|£V''/C»«<| \r« 



i = r i 

Jo 

r r*oo 

e~* st \ fit) \ dt < I e~ Kst Me ct dt 
Jo 

= M T e-^- c »dt = °°= M 

Jo V “(Rj -c) ) t = 0 



\fit)\dt 



— . □ 

R^ -c 

Furthermore, we see that in the right half-plane of convergence Rs > c we have the estimate 
M 



TO < 



R^ -c 

which implies that Fis) — > 0 for Rs — » oo . 



A function satisfying the above proposition is called a function of bounded exponential 
growth. Hence functions of bounded exponential growth have a Laplace transform. 
Conversely, functions need not be of bounded exponential growth in order to have a Laplace 
transform. A simple example of a function that does not have a Laplace transform is fit) = e * 2 . 

Besides the correspondence sign fit) ° - ■ F(s), we also use the following notations: 

F = £f, f = £~ l F. 

But more often we shall explicitly indicate the original function variable and the image 
function variable by writing 

F(s) = £ [/(/)] Os), F(s) = £f(s), f{t) = £- l [F(s)}{t\ f(t) = £~ l F{t). 

Problem 1.1. Compute the Laplace transforms of the given original functions and determine 
their abscissa of convergence. 

a) t b) t 2 c) f 1 (n positive integer) d) cos to t e) uit) -uit- 1) 
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■ 1.1.2 Operational Properties 



1.1.2.1 Linearity 

The Laplace transformation is a linear operator. The sum of two original functions corresponds 
to the sum of their image functions. If an original function is multiplied by a constant, then the 
image is also multiplied by this constant. This is because the defining integral has these 
properties, which can be combined into one statement. 

Proposition. The Laplace transform of a linear combination of originals is the linear 
combination of the corresponding images: 



\2] c kfM 



(s) = 'fj c k £[fk(t)](s) . 



( 1 . 2 ) 



By making use of the correspondence f 1 ° - ■ n!/s n+1 it is easy to compute the image of a 
polynomial by use of linearity: 



n 






n 



I 

j-=n 




Problem 1.2. Compute the image functions of 

a) cosh at b) sinh at c) 3 u(t) - cos t + t 3 - 3 e~ 2t 



Problem 1.3. The inverse Laplace transform of a given image function is unique. Find the 
inverse Laplace transform of the following image functions: 

5s - 3 as + b 5s - 3 as + b 

s 2 + 4 s 2 + co 2 s 2 - 4 s 2 - oj 2 



1.1.2.2 The Integration Rule 

If f(t) * - ■ F(s), what is the image function of g(t) := £f(x) dxl We can write 
G(s) := £ e~ s ‘ g(t)dt 

r W r*oo r* oo 

e~ st I f(x)dxdt = I /( jc) I e~ st dtdx 

Jo Jo Jjt 

by interchanging the order of integration in the double integral (draw the 2-dimensional 
integration domain). If Rs > 0, we can evaluate the inner integral and write 



r r*oo 

f(x) I e~ st dtdx 

J x 

= rnx^dx^r f(x)e~ sx dx = 

Jo s s Jo 



F(s ) 



s 



s 
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Hence we have obtained the integration rule. 
Proposition, fit) * - ■ F{s) implies 



f 

Jo 



f(x)dx -F(5) (Rs > 0). 
s 



(1.3) 



This says that integrating an original function from 0 to t amounts to dividing the image by s. 
By iterating this rule, we obtain 



r* p x 3 r * 2 

Jo Jo Jo 



f(x l )dxidx 2 ...dx n 

s n 



Consider the following line of thought: 



u(t) = 1 ° 



t ° 



-■i-r 

S Jo 

-.i- =,(%,«,= 

s 2 Jo 



Idx - t n -• — , 



c3 ’ 



‘‘ — 7 T’-f =* '’-‘ 7 - 



In general, 




Problem 1.4. Use the integration rule and the result of Problem 1.3 to find the inverse Laplace 
transforms of the image functions 

5s - 3 as + b 
,sCs 2 + 4) ’ s(s 2 + oj 2 ) 

1.1.2.3 Differention Rules 

It can be shown that an original function fit) that is differentiable for t > 0, with a Laplace 
transformable derivative /' it) , is itself Laplace transformable. How does the Laplace 
transform of /' it) relate to Fis) = £ fis) ? Before finding the differentiation rule, let us note 
the following: If fit) is assumed to be differentiable for t > 0, then fit) is also continuous for 
t > 0. The differentiation rule as stated below is only true if fit) is continuous for all t > 0. 
This means that the original fit) can only have a discontinuity at t = 0. 

What is the image of /' it) if the image of fit) is Fis) ? Suppose that the derivative of fit) has 
a Laplace transform, then 

f f (x) dx = fit) - /(0 +) ° - ■ F(s) - ^1. 

Jo s 

But the Laplace transform of the left-hand side, by the integration rule, equals Gis)/s, if Gis) 
is the image of git) := /' it). Hence 
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G(s) _ /( 0+) 

s s 

G(s ) = £[/' (t)](s) = s F(s) - /(0+). 

Remark. We needed to write /( 0 +) rather then /( 0), because an original function can have a 
discontinuity at t= 0. Remember that f(t) vanishes for negative t, which implies that 
/( 0 -) = 0 , while /( 0 +) can be non-zero. 

The fundamental differentiation rule given by the implication 

f{t) ■ - ■ F(s) =* f (t) □ - ■ j F(s) - /(0 +) (1.4) 

can be iterated, provided that for higher derivatives of f(t) the Laplace transforms exist. 

/'«□-■ sF(s) -/(0+) 

=> f ms [S F(s) - f(0 +)] - /' (0 +) 

= j/(o+) - /'(o+), 

f (0 ° ■ * 2 m - * /(o +) - /' (o +) 

=»/® (/)»-■ .v/( 0 +) - /'( 0 +)] - f" ( 0 +) 

= i ' 3 F(s) - s 2 /(0 +) - .s f (0 +) - /" (0 +) . 

In general, we have the following result: 

Proposition. If /(f) ° - ■ F(^), 

n 

f in \t) = - ■ s" F(s) - ^ / i_1) (0 +). (1.5) 

£ = 1 

Example. Find the solution of the initial value problem 
d 2 y 9 

— f- + co 2 y(t) = 0 , t > 0 , 
dr 

y (0 +) = a, y' (0 +) = b . 

We assume that the unknown function y(t) has a Laplace transform T(s). The differentiation 
rule together with the linearity imply that the image equation of the differential equation is 

s 2 Y(s) - sa - b + a) 2 Y(s) = 0. 

It is easy to solve this equation for the unknown Laplace transform Y(s), namely 

as + b s b a) 

Y(s) = — — = a — t- + 9 5 -. 

s z + u) z s z + cj z a> s z + a> z 

By use of linearity again, and two known correspondences, we obtain at once the solution 

b 

y{t) = acosajt + — sm cot. 



Problem 1.5. Find the solution of the initial value problem 
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d 2 y 7 

— - — a 2 y(t) = 0, t > 0 , 
dr 

y(0+) = A, /«>+) = *. 

Problem 1.6. Solve the initial value problem 

d 2 y 9 

— Y + o) 2 y(t) =1, / >0, 

dr 

y(0+) = 0, /(0+)=0. 



1. 1.2.4 The Image Shift Rule 

Knowing the correspondence /(*)□-■ F(s), one may want to find the original function 
corresponding to F(s - a). The answer is surprisingly simple. Consider the following: 

e~ st f(t) dt => F(s - a) = e^ (s ~ a> ‘ f(t)dt 

e- st {e al f(t)} dt. 

The last expression on the right-hand side is the Laplace transform of e at fit). Thus, we 
proved the 

Proposition. For any complex number a it holds that 

fit) □ - * Fis) e? 9 fit) n-uFis-a) . (1.6) 





If in an image function 5 is replaced by s- a, then the corresponding original is multiplied by 
the exponential factor e at . Clearly, we can also write 

fit) □ - ■ Fis) «=> <T fl ' fit) - - ■ Fis + a). 

This simple but important rule has many applications. For example, let us compute the original 
function that corresponds to 

as + b 

Fis)= - — 

s z + 2 k s + o) 1 

By completing the square, we can write 

as + b ais + K) + b-aK 

S 2 + 2 K S + CO 2 is + K ) 2 + (Jj 2 - *2 

According to whether the discriminant cj 2 - k 2 is positive, zero, or negative, we distinguish 
the following cases: 

(i) The discriminant is positive. We set ft 2 := o? - k 2 and write 

as + b (s + k) b-aK f 1 

s 2 + Iks + a) 2 ~ is + K ) 2 + FL 2 ^ is + k) 2 + Ft 2 ' 

We apply the image shift rule, linearity, and the (known) correspondences 
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s 

s 2 + n 2 



■ - ° cos n r, 



n 

s 2 + n 2 



■ - ° sin fl f 



to obtain 



as + & 

s 2 + 2 /c s + a> 2 



"{a 



cos rtt + 



b-aK 



n 




where fl = \j co 2 - k 2 . If k> 0, then the above original represents a damped harmonic 
oscillation. 



(ii) The discriminant is zero. Then we write 
as + b 1 



s 2 + Iks + co 2 



(s + k) 



+ (b-aK) ■ 



(*+*r 



By applying the image shift rule again, linearity, and the correspondences 



1 



1 



— ■ - D 1 ( = w(0), 



we obtain 



as + b 

S 2 + 2 K S + CO 2 



° e Kt {a + (b - a K)t] . 



If /c > 0, then the original on the right-hand side represents a critically damped harmonic 
oscillation. 



(iii) The discriminant is negative. By setting ft 2 := k 2 - co 2 , which is now positive, we obtain 

n 



as + b (s + k) b-aK 

s 2 + 2ks + w 2 “ (s + k) 2 - Cl 2 n (s + k) 2 - il 2 



Thus 



as + b 



s 2 + Iks + co 2 
The right-hand side can also be written as 



Kt | a cosh fl t + sinh H f j. 



1 

2 



la + 



b -aK \ (K -g )t 

a r 



+ 




b-°« \ (K+n )t 
n r 



with XI = V K 1 - co 2 . This is left to the reader as an exercise. In the case of k > 0, the above 
original represents an overdamped harmonic oscillation. 



Problem 1.7. Show that the following initial value problem, 
d 2 v dv o 

— f- + 2 k — + co 2 y(t) = 0, t > 0, k > 0 , 
dr dt 

y(0 +) = a , 

/ (0 +) = b, 

models a damped, a critically damped, or an overdamped harmonic oscillation, according to 
whether the discriminant co 2 - k 2 is positive, zero or negative. 
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1.1.2.5 Original Shift Rules 



There are two rules according to whether a given original function is shifted to the right or to 
the left. We first consider the case where the graph of an original is shifted to the right. 
Remember that a given functional expression fit) defines an original function that is explicitly 
written as u(t) fit). If the graph of this original is shifted by c units to the right, where c is a 
positive constant, then the shifted original is represented by u(t - c) fit - c) . What is the 
Laplace transform of this shifted original? Because 



r 0, t < c 
“ ( '- C) = h, ,*c 



u(t-c)f(t-c) 



j 0, t < c 
\ /(/ - c), f a c , 



u(t-c)f(t-c )° -■ F e st f(t-c)dt 



■f* 



- s (t+c) 



f(t)dt = e 



"f 



e~ st fit) dt = e- cs Fis). 



Hence we obtain the First Original Shift Rule: 



Proposition. If c> 0 and fit) = uit) fit) ° - ■ Fis), then 



u(t-c)f(t-c)°-m e~ cs Fis ). (1.7) 

An original function that is shifted c units to the right has an image function that is multiplied 
by the factor e ~ cs . 

The graphs in Fig. 1.2 and Fig. 1.3 are meant to clarify what shifting the original by c = 5 units 
to the right means: 



f (t) 




Fig. 1.2: A typical original 
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u (t-5) f (t-5) 




Fig. 1.3: The above original shifted to right 



Let us proceed to the second original shift rule. If a given original function fit) u(t) fit) is 
shifted by c> 0 units to the left, the shifted function would be represented by uit + c) times 
fit + c) . But this, in general, is not an original function (it could have non-zero function values 
on the interval [-c, 0] ). We need the expression uit) uit + c) fit + c) = w(f)/(f + c), which 
again is an original function. The last expression, when applying our convention, is simply 
written as fit + c) . Its Laplace transform is given by 



f(t + c)°- m j^°e- s ‘f(t + c)dt 

r f'OO 

e -sU-c) f(t) dt = 

c 

This is the Second Original Shift Rule: 



e~ s> f(,t)dt 
' f(t)dt\ 



Proposition. If c>0, then /(f ) n - ■ F(s) implies 



f(t + c) := u(t) fit + c) 



□ 



F{s) - 




f(t)dt 



( 1 . 8 ) 



The graph of /(f + c) := u(t) f{t + c) is obtained by translating the graph of the original /(f) by 
c units to the left and then truncating the part of the graph that is over the negative real axis. 

Definition. The right-most expression in (1.8) 



F c (s) = F(s, c) := 




mat 



is called the finite Laplace transform of /(f). 



(1.9) 



Problem 1.8. Compute the Laplace transforms of 
u(t - c ) cos (f - c) and cos(f - c). 
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Problem 1.9. Compute the Laplace transform of 
u(t)cos(t + c) = cos (t + c) 

in two different ways: (i) By use of the second original shift rule; (ii) by use of the identity 
cos (t + c) = cos c cos t - sin c sin t. 

1.1.2.6 The Similarity Rule 

Suppose you know the correspondence f(t) ° - ■ F(s) . What is the image function of f(c t ), 
where c is a positive constant? We readily obtain 

r*oo 

f(ci)°-m I e~ sl f(ct)dt 

Jo 

by a simple change of variable. This is the similarity or scaling rule: 

Proposition. If f(t) a - ■ F(s), then , with c> 0, 

/(Cf)°-" (1.10) 

C \ C ' 

Replacing c by 1 /c and using the linearity property yields 

F(5)--=/(0=^F(c5)--o L /(-^-) . (1.11) 

What is the original corresponding to F((s - b)/c)l By the similarity rule, 

F (c") ■“ D cf(ct) 

and by the image shift rule, we finally obtain 
- °c e bt f(ct), c > 0. 

Similarly, we find 

F(cs + b) ■ - a — e~^ c)t j, c > 0. 

1. 1.2.7 The t-Multiplication Rule 

We know that the domain of the image function F(s) of a given original f(t) is always some 
half-plane of the form Rs > xo . The higher derivatives of F(s) may be found by differentiating 
under the integral sign, i.e., 
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On the right-hand side we have the Laplace transform of (-t) n fit). This yields the t- 
multiplication rule. 



Proposition. If fit) ° ■ F(s), then 

d n F 



f fit)*- m (-If 



ds n 



We also can speak of the image-differentiation rule: 

F(s) - - □ /(f) => F™ /(f ) . 

Example. 



( 1 . 12 ) 



(1.13) 



sin co t ° - i 



co 



S z + (j) z 



t sm co t ° - ■ - 



2 cos 



ds s 2 + a) 2 is 2 + o> 2 ) 2 ’ 

Problems 1.10. Compute the image functions of t cos co t, t 2 sin cot t 2 cos cot, f 1 e at . 



1.1.2.8 The Image Integration Rule 



Multiplying an original function by t amounts to differentiating its image function and 
multiplying by -l.Thus, we may expect that dividing an original by t amounts to integrating 
the corresponding original. Under certain assumptions this is true. First, fit) being an original 
function does not necessarily imply that f(t)/t is an original, too. The reason is that the 
Laplace integral of f(t)/t need not converge; for example take fit) = uit) / 1 : the Laplace 
integral does not converge at its lower limit. In order to avoid this, we require that | fit) \ /t is 
integrable on any finite interval [0, b] . This is satisfied if lim^ 0+ fit) It exists, i.e. if it is 
finite, and for example for fit) = f , Ror > 0, since fit) / 1 - t a ~ l is integrable on [0, b] . Let 
us now prove the following rule: 



Proposition. If fit) ° - ■ Fis) and 




dt < oo for any b > 0, then 



fit) _ 

t 



r 



F{p)dp 



(Rs > 0) . 



(1.14) 



Proof. Consider 
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r s^oo r^OO 

F(p)dp = I I e~ p ‘ fit) dt dp 
J s Jo 

= r r e~ pl f(t)dpdt 

Jo Js 

where the order of integration is changed. Furthermore, 

r r e ~ pt f(t) dpdt 

Jo Js 

r C°° C°° ( e~ pt \°° 

f(t)J e ~ pl dpdt = J /«[— J dt 

For example, take /(f) = sin t. Clearly f(t)/t exists if t -» 0 + . Applying the above, we obtain 



sinr r 1 . f 1 -1 

' °'“1 ""1 (tf + i P 



r 1/s l 
Jo P 2 + 1 



dp = (arc tan p)g /s = arctan — . 



Problems 1.11. Find the Laplace transforms of 

1 - e~ f 1 - cos f 

and 



t t 

Problem 1.12. If y/T ° - ■ / (2 s V^) , find the Laplace transform of 1 lyfT . 



1. 1.2.9 The Convolution of Originals and the Convolution Rule 



Two original functions can be combined by forming the so-called convolution or convolution 
product. 

Definition. Let /(f) and g(t) be two original functions, then the convolution of f and g, 
denoted by / * g, is the original defined for t > 0 by 



(/*£)« 



/ 



f(t — x)g(x)dx 



(1.15) 



The convolution product is commutative, distributive and associative. The commutative law is 
seen as follows: 



C g*f)(t ) 



/ 

Jo 



g(t - x) f(x) dx 




g(y)f(t-y)(-dy) 



by a change of variables y = t-x. The latter integral can be written as 
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g(y)f(t-y)(.-dy) 



r 

= I g(y)f(t-y)dy = I f(t-y) g(y)dy = (f*g)(t). 
Jo Jo 



This proves the commutative law g*f = f*g. 

The proof of the distributive law f*(g + h) = f*g + f*h is readily done and is left as an 
exercise to the reader. 



The convolution of three originals is defined by 
( f*g*h)(t ) : 



•= I | fti-xi -x 2 )g(xi)h(x 2 )dxi dx 2 , 

J J 0<Jti +X2 <t 



and the convolution of four originals is 
(f*g*h*k)(t) := 

f(t -X1-X2- *3) g(xi ) h(x 2 ) k(x 3 )dx 1 dx 2 dx 3 , 



III 



+JC2 +JC3 <t 

and so on. 

Let us prove that f*g*h = (f*g)*h , establishing the associative law: 

(/ *g*h)(t) := I I f(t -X1-X2) g(x 1 ) h(x 2 ) dxi dx 2 

J J0<Xi +X 2 ^ t 



■a 
-r 



f(t -X 2 -Xi) g(Xi ) dxi h(x 2 ) dx 2 
( f *g)(t-x 2 )h(x 2 )dx 2 = ((/ *g)*h) (t). □ 



One of the comer stones of the method of Laplace transformation is hidden in this operation of 
convolution, namely that the image function of the convolution of two originals is the ordinary 
product of the two image functions! This is stated in the 



Convolution Theorem. If fit ) n - ■ F(s) and g(t) °-u G(s), then 
(f *g)(t) ■= f fit - x) g(x) dx°-m F(s) G(s). 



( 1 . 16 ) 



The convolution product of originals corresponds to the ordinary product of their images. 

Consequently, whenever we encounter products of image functions, we form the convolutions 
of the corresponding original functions. 

Proof F(s)G(s) = 

f°° e~ st f(t)dt r e~ s, g(t)dt = f f e~ s{x+y) f(x)g(y)dxdy, 

Jo Jo J Jd 
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where the 2-dimensional integration domain D is the infinite square that coincides with the 
first quadrant. By a change of variables 

(jc, y) ■ — » (f, r); t = x + y, r = y <==> x-t-r, y = r 

with Jxdy = | d(x , y)/d(t , r) | dfdr = dfdr: 



f f D e ~ S<X+y> fWsWdxdy = f JV*' 



f(t-T) g(T)dtdr 



where the domain D = {(x, v) | 0 < x < <x>, 0 < v < co} is transformed into the domain 
D ' = {(f, r) | 0 < t < oo, 0 < t < t} . Therefore 



f f C S ‘ 8(T)dtdr 

= f°° e~ st f f(t-T)g{T)drdt (J*g)(t). □ 

Jo Jo 

As a special case, if f(t) = u{t) = 1 , we have the integration rule, found earlier: 

1 



(l*g)(r) = I g 
Jo 

As another example, we compute the general solution of the initial value problem 



g(jc) dx ° - ■ — G(s). 
s 



J 2 y 9 

-4- + y(t) = /(O , t > o , 
dr 

y(0+) = a, 

?(0+) = b. 

We assume that the right-hand side /(f) has the Laplace transform F(s). If y(t) °-uY(s) the 
image equation of the given differential equation is 



s 2 Y(s) - sa - b + oj 2 Y(s) = F(s). 



Solving for the unknown Y(s ), yields 

F(s) + as + b \ co s b a> 

Y is) = 2 - 2 = ~ 2 F(s) + a - 2 + - - 2 -- 2 . 

S l + 0) z 0) S z + CO 1 S z + (O a 0) S z + <jl> Z 

The first term on the right-hand side is the product of two image functions, thus we apply the 
convolution rule to obtain 



1 b 

y(t) = — sin t * fit) + a cos cot + — sin cj t 

0) Cl) 



-if 

^ Jo 



sin(f - jc) fix) dx + a cos o t + — sin o t . 

co 



A pleasant application of the convolution theorem is the computation of the volume of an n- 
dimensional sphere: 



Let , ... , x n refer to an orthogonal cartesian coordinate system in n -dimensional space. The 
volume V n iR) of the n -dimensional sphere of radius R is given by 
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dx\ ...dx n . 

xf +•••+ x%<R 2 

On account of the symmetry with respect to the center of the sphere we may also write 

dxi • • • dx n 

D 

where the coordinates are restricted to positive values, i.e. the integration domain D is 
specified by 

x\ > 0, , x n > 0 , jcf + •••• + x^ < R 2 . 

A change of variables Xk = VwiT , dxk = 1/2 \[~Uk duk , yields 

V n (R)= f * f , — — -dui---du n 

J J V«1 • • -V«n 

0<«! +-'-+u n <R l 

7 1 1 

u(R - Ml U n ) t • • • fifMi • • * dli n 

yu\ yfun 

0<«i +•• +u n <R z 

which is the (n + 1 )-fold convolution product 




V„(R) 



r 



V n (R) 



- If 



( u(t) * —pr * ■ • *-U 
\ yt yt ) i=R 2 

( u(t ) denotes the unit step-function). The convolution theorem implies (also see Section 
1. 1.3.2) 



1 yfn Vtt if 112 

By taking the inverse Laplace transform, we obtain 
it*- 



V„(R) = 



S n / 2 + 1 

f* 






M ) = 

V T(n/2 + 1) ) t=R 2 



7t* 



T(n/2 + 1) 

Hence, in one, two, three, and four dimensions: 



R n 



V ] (R)= ~^—R = 2 R, V 2 (R)= kR 2 , 

v^r/2 

TT^/2 4- 7T 7T 2 

V 3 (/?) = —=— R 3 = ^-R 3 , V 4 (R) = — R 4 . 
3yJn/4 3 2 

Observe that dV n (R)/dR yields the area of an n -dimensional sphere. 
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1.1.2.10 Efros’ Theorem 

Efros’ theorem is a generalization of the convolution theorem that paves the way for many 
interesting new correspondences. In order to establish this important theorem, we assume 
f(t) a - ■ F(s) and that also a correspondence of the type 



G(s)e 



-q(s ) t - _ t 



g(t, r) 



holds, where the Laplace transform is taken with respect to t and r is a parameter. From f(t) 
and g(t, t) we form the new original 

hit) = g(t,T)f(T)dr 

and compute its image 

H(s) := £°e- s, h(t)dt 

r pOO 

e~ st I g(t, t) f(r)dr dt 
Jo 

/*oo poo 

= I I e~ st g(t, t) f(r)dr dt. 

Jo Jo 

Interchanging the order of integration yields 

poo poo 

I I e~ sl g(t, r) /(t) dt dr 
Jo Jo 

= J '°° e~ s, g(t,T)dt)dr 

= J°° /(r) G(s) e- q(s)T dr 

= G(s) f(T)e~ q<s > T dT = G(s)F[q(s)] . 

This results in H(s) = F[q(s)] G(s) . We have established 

Efros’ Theorem. Let F(s) ■ - ° f(t) and G(s) Exp[- q(s) r] ■ - n g(t, r) . Then 



F[^)] G(s).-°£° g(t, r)/(r) dT . (1.17) 

For q(s) = s, and by the original translation rule, we obtain 

G(s) e~ q(s) T = G(s) e~ ST m-° u(t-r) g(t - r) = g(t , r), 
where g{t) is the original function of G(s). In this special case, Efros’ theorem yields 
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F^fCO] G(s) = F(s) G(s) m - o J"°° U (t - r) g(t - r) /(r) dr 

■r)/(T)dr = (g */)(/) = (/*g)(0 
which is the convolution theorem from before. 



= r 

Jo 



From Efros’ theorem we will obtain interesting and useful special cases. By making use of the 
correspondence 



-a V7 



1 



- a 2 / (At ) 



yfs y[nt 

in Efros’ theorem, we have G(s) = 1 / #Cs) = V$\ and r = a. Thus 



r) = 



„-t 2 /(40 



yfitt 

and finally, if F(s) ■ - ° /(r) , 

F(VI) 






VI 



By taking q(s) = .v + 1 / s and G(s) = 1/swe have first 



( 1 . 18 ) 



G{s)e~ qis)T = — e -< s+lls)T = e~ TS 



,,-t/s 



Then by use of the correspondence 

e~ T/s 



I - - J 0 {2 Vr7) , 



(1.19) 



where Jo it) is the Bessel Function of order zero, we conclude, by use of the original shift rule, 



that g{t, r) = u{t - r) Jq{2 Vr(f-r)). Therefore, by Efros’ theorem, if F(s) m - □ / (t ) , 



J^+t) 



'-°f M 2 ^ T(t ~ T '>)f (T ^ dr - 



d-20) 



Example. When F(s) = 1 / VI ■ - ° 1 / VH = /(/) , we find 

1 1 r* 7 0 [2 Vr(t-T) 



- f : 

fn Jo 






dr. 



sy/s+l/s \fn 

The left-hand side equals 1 / (V^ V s 2 + 1 ) which, by the convolution theorem, gives 

1 1 1 fJoit-r), 

■ — □ | dr 

>fs yjs 2 + 1 V^r Jo Vt 
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where the correspondence 1 / Vs 2 + 1 ■ - ° Jo(t) is used. We established, rather suprisingly, 
that 



/ 



J 0 [2 V r(f - t) ] 

V7 



</r 



r Joit-T) 

Jo yfr 



dr . 



If g(s) = l /s and G(s) = 1/s, then correspondence (1.19) yields git, r) = and 

Efros’ theorem implies, if F(s) ■ - ° /(f), 






Ifq(s) = In 5 , G(s) = l/.y,then 

G(s) e~ q(s)T = ~ ° g{t , r) = 



^r+i ov '’ ' 7 r(T+l) 
Therefore, by Efros’ theorem, if Fis) ■ - ° /(f), 

F(ln/) 



!-□ r — /(T)flT. 

Jo r(r+l) A; 



Example. By use of F(,s) = l/^>-° 1 we find 
1 r°° f 

— ■ “ D -p/ , i\ " dr = : V W ’ 
5 In 5 J 0 T(t + 1 ) 

v(f) is called a function of the Volterra type. 



( 1 . 21 ) 



( 1 . 22 ) 



1.1.2.11 The Initial and Final Value Theorem 

One of the advantages of using the Laplace transformation to solve differential equations is 
that the asymptotic behavior of the image function for s -» 00 and for s 0 is related to the 
asymptotic behavior of its original function for t -» 0 + and for t -» 00 , respectively. The 
asymptotic relations between an image function and its original is important, but not on an 
elementary level and will be treated in Section 6.2. Here we shall introduce two simple 
theorems which are basic instruments in the method of Laplace transformation. 

The Initial Value Theorem. If the limit lim r _ > o+ fit) = /( 0 +) exists , it can be computed by 

fi 0+) = lim s Fis), q 23 ) 

.v — >00 V * 7 



where Fis) is the Laplace transform of fit). 

The simple fact that s Fis) has a limit, when s tends to infinity, does not imply that /( 0 +) 
exists. This is readily seen in the following correspondence: 

— p=r COs(— ) D - ■ — 7=r e~ ^ COS '[is . 

Snt v 1 ' ys 
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A simple proof for the case that /' (t) has an absolutely convergent Laplace integral, which 
means that there exists an jt 0 such that 

e~ Xot i /' (t)\dt < oo, 

is as follows: By the differentiation rule, we obtain 
£° e~ st /' (t)dt = sF{s) - /(0 +). 

The above assumption allows interchanging the limit and the integral 

r r»00 

e~ st f (t)dt = I lim e~ st f (t)dt 

Jo s ^°° 

/~*oo 

= I Of ( t)ds =0 = lim sF(s) - /( 0+) 

Jo s ~*°° 

=> lim s F(s) = /( 0 +) . □ 

S-* OO 

The Final Value Theorem. If the two limits below exist, then they are equal: 



lim/0) = lim sF(s). 

t-*o O J->0 



(1.24) 



Under the same assumption as for the Initial Value Theorem, the following steps are allowed: 
lim sF(s) - f(0+) = lim / e' st f (t)dt = lim lim | e~ st f (t)dt 

^->0 s-»0 Jq 5-»0 b — >oo Jq 

= lim | lim e~ st f (t)dt = lim j f 

b-*o° Jq s -> 0 b -> oo Jq 



( t)dt = lim {/W-/(0+)} 

b-*oo 



= lim /(0 - /(0 +) => lim j F(s) = lim f(t ) . □ 

t-* oo i->0 f — >oo 

Again, note that if one or both of the limits do not exist, the theorem does not hold. As a 
counterexample, take f(t) = sin t. 



1.1.2.12 The Expansion Theorem of the First Kind 

This theorem can be used to transform back a series of inverse powers of s. We assume that 
F(z) is a holomorphic function at z = 0 with F(0) = 0. This means that for some R > 0 the 
convergent power series 

oo 

F(z) = 'YjCkZ?, \z \ <R 

k= 1 

holds. Due to Cauchy’s inequality (a result from complex function theory), we have the 
estimate 



M 

i cf i < — r- 
* R k 



Let us consider the power series 




Laplace Transformation 



21 



*»-Z 



k=l 

We have the estimate 



OO OO M M 

„ I Cjc I 7_i M 

l/Wl s Z(TT>T m ' 



t I 



1-1 



Af f 1 /in x*” 1 M ( \ t\\ M ( t \ 

= T L oTTyr hr) = T exp (-y-) = T exp ( * ) 

since t is positive. This means that the power series for f(t) converges for all complex t and 
moreover that /(f) is of bounded exponential growth for t -> oo . Thus u(t) f(t ) is an original 
function. The above estimate allows a term by term integration: 



fit) = V -* f*- 1 



1=1 






Ck 



(k- D! 



-57 ^-1 



r °° /-»oo 



= y — 

fjt- 



C* (*-l)! 



t= J , (*-!)! 
We have thus proved the 






Expansion Theorem of the First Kind. Tjf F(,s) w holomorphic at s = oo with lim^^ F(s ) = 0 
and has the series representation 



F ( s)= lL^t' >i/«. 

k= 1 



f/iew f/*£ entire function 



/»-Z«FiJT« w - 



A: = 1 



multiplied by u(t), is the inverse Laplace transform ofF(s). 

Example. 



F(s) = 





1 

$k+n + 1 



Z (-i)* t* +n 

k ! (fc + ti) ! ’ 



Since the Bessel function J n (z ) is defined as 
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MZ) = 



oo 




(- 1 )* 

k\ 



(|) 2 * + " 
(k + n ) ! ’ 



we have 



?*],( 2V7).£<^ 

k = 0 



(f 1/2 ) 



2* + 2« 



(k + w) ! 



Z (-l)* 

k\ (k + ri)\ 



Finally, 

'.(2 VT) — ^ 

Problems 1.13. Assuming F(s) ■ - ° f(t) use the correspondence 




to establish 

f,v7) — ^r T “ , f£) /<r) ‘' T ' 

Problem 1.14. Use the result of Problem 1.11 to show 



F(Vi ) ■ - ° + 



yfnt yfnt 






Problem 1.15. Establish 



+ 2 bt + c)]dt 



J '°° exp[- (ar 2 

- o>0 

where erfc(x) := 2/ \pn ^ e~^ dt is the Complementary Error Function. 

Problem 1.16. Use the formula of Problem 13 and the formulas derived from Efros’ theorem 
to establish the following correspondences: 



1 



A fs (V7 + b) 



\-o erfc (b VF) , 



V7 + & V^r7 

Problem 1.17. For t > 0, prove 



=- - b e 1 ^ f erfc(fr yft ) . 



cosf 



r * o o /too 

= I 7o( 2 VF7) sin r^r, sint = I / 0 (2 Vt7)cost*Jt. 

Jo Jo 
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■ 1.1.3 Some Special Functions and their Laplace Transforms 



1.1.3.1 Periodic Original Functions 



An original function fit) (remember f(t) = Ofor t < 0) is periodic if there exists a positive 
constant T such that fit + T) = fit) V t > 0. The smallest positive constant T that satisfies the 
above relation is called the fundamental period of fit). Observe that this defining relation 
immediately implies 

f{t + T) = fit) = fit + kT) 
for all positive t and any positive integer k. 



The Laplace transform of a periodic original has a remarkable form: 
m = f(t + T) o-m F(s) := jH e~ st f(t)dt 

00 pkT pT 

= Y e~ s ' fit) dt = V I e~ s(,+kT) fit + kT) dt 
k = o J * fc o 

oo t oo t 

= e ~ S * T f e ~ St f^ t + kr > dt = ^ j e- skT ^ e~ st f(t)dt 
k=0 ° 

pT 00 

= e~ st fit)dtYi 

OO iZn 



k = 0 



-skT 



k = 0 

Adding up the infinite geometric series yields 



OO OO 1 

= ttftt «*>»> 



k = 0 



k=0 



Thus we have established the general expression for the Laplace transform of a periodic 
original. 

Proposition. The Laplace transform F(s) of a periodic original fit) = fit + T) is given by 



< 12S ) 

Without proof we state the fact that a finite Laplace transform 

F T is):= Ce~ st fit)dt 
Jo 

is always an entire holomorphic function (a function of the complex variable s without 
singularities in the finite complex plane). Hence the only singularities of F(s) are the zeros of 
the denominator which are all simple and given by s* = In ki/T with k running through all 
integers. Hence we see that the Laplace transform of a periodic original is a meromorphic 
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function whose poles are all simple and evenly spaced along the imaginary axis. A 
meromorphic function is a function of a complex variable whose only singularities are poles. 

A periodic function often has a symmetry. Periodic functions may be even or odd functions or 
having a symmetry of the third kind. 

Definitions. A periodic original f(t) with period T is even (odd) if the two relations 

(i) f(t + T) = f(t ) V t > 0, 

(ii) /(0 = f(T-t) (f(t) = -f(T-tl 0 <t<T) 

hold. A periodic original f(t) with period T has a symmetry of the third kind if the three 
relations 



(i) f(t + T) = f(t) V f > 0, 

(ii) fit) = f(T/2- t\ 0 <t<T/2, 

(in) fit) = -f(T - 1), 0 <t<T 

hold. A periodic original with a symmetry of the third kind is a special case of an odd periodic 
original. 

The graphs in Figs. 1.4, 1.5, 1.6, 1.7 may illustrate the various types of periodic original 
functions. 



f (t) 




f (t) 




Fig. 1.5: An even periodic original function of period T = 2. 
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Fig. 1 .6: An odd periodic original function of period T = 2. 



f (t) 




Fig. 1.7: A periodic function with a symmetry of the third kind. 

Example. Compute the Laplace transform of the periodic original with period 2 n and given by 
f(t) = t 2 for 0 < t < 2 7i. 



r 2n 2 

F(s, 2 jr) = e~ s 't 2 dt= — 
Jo s 



e~ 2ns (4 tt 2 s 2 +4ns + 2) 



We obtain 



F(s) = 



2-e 2ns (4 7r 2 s 2 + 4ns + 2) 



sHl-e~ 2 * s ) 

At the first glance, it seems that 

2-e- 2ns (4n 2 s 2 +4ns + 2) 
F(s , 2n) = r 



has a singularity at s = 0 and is not an entire function as stated above (finite Laplace 
transforms are always entire functions). But the singularity is removable, because the 
numerator can be expanded as follows: 



2 - e~ 2ns (47T 2 s 2 +4ns + 2) 



8 ;r 3 

"T" 



s 3 - 47 r 4 s 4 + 




+ ••• . 



1.1.3.2 The Gamma Function 

We define the gamma function by Euler’s integral, i.e. by 



26 



Chapter 1 



r(z):= J^f-'e-'dt (Rz > 0). 

Integration by parts immediately yields the important recursion formula 

zT(z) = Hz+l). 

Because 



r(l) = J^°e~ x dx = 1 

recursion implies that, 

r(2) = ir(i) = i, r(3) = 2Y(i) = 2.1 = 2, r(4) = 3r@) = 3.2 = 31, 

hence, for any positive integer n, 

T(n + 1) = n ! 

This shows that the gamma function can be regarded as a continuous interpolation of the 
discrete factorial function f(k) := (k - 1) ! (k = 1, 2, 3, ...) (see Fig. 1.8). 

r(x) 




Fig. 1.8: Graph of the gamma function. 

Note that, by a change of variable t = x 2 , one obtains 




From this and the recursion formula, we have 




In Euler’s integral we compute, by a change of variables t = s x, where s is fixed with Rs > 0, 

(?xf e~ sx dx = j a+1 <T S * dx . 



r r*00 

f e~ x dt = 5 I 

Jo 



The integral on the right-hand side is the Laplace transform of t a . We assumed that Ror > - 1 , 
so the Laplace integral converges at its lower integration limit 0, otherwise there is no 
restriction on a. Thus, we have established the important correspondence 
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F(Qr+1) , Rar > -1. (1-26) 

S° +l 

This formula generalizes the known correspondence 
„ r(n+l) n ! 

t □ — ■ = 

j-n+l ^n+1 

for real or complex exponents. For a = - 1 / 2 and 1/2 we have the correspondences 
1 



Vt Vs 



VH , I— Vn 1 
and V t ° - ■ — — 






By applying the image shift rule to the first correspondence, we obtain 






VH 



V7 V S — i Cl) Vt 

Then, by linearity, 

yfn 



y/s + io 
yfj r 



Vi 

COS QJt 



y/ s - ico yjs + icj 

yfn y/s + ico + y/s -ico 



yft 2 V s 2 + a> 2 

7r V V -s 2 + ^ 



2 

Similarly, we obtain 



sin&>£ 

~7r 



7r yj s 2 + ~( 



V 



S z + O ) 2 



1. 1.3.3 Bessel Functions 

Let us start with the second order linear homogeneous differential equation called the Bessel 
Differential Equation 

t 2 w" ( t ) + tw'{t) + (r 2 - n 2 )w(t) = 0, neZ. 

Any solution of this differential equation is called a cylinder function. Because the differential 
equation is linear and homogenous, any linear combination of solutions is again a solution. In 
order to find a solution we first set w(t) = t~ n y(t) . The Bessel Functions are defined as the 
particular solutions w(t) = : J n {t) that satisfy the relation ny( 0+) = 0.Let us now find the 
differential equation that is satisfied by y(t) . We have 

tw' (t) = -n t~ n y(t) + t~ n+l y' (t ) , 

t 2 w" ( t ) = n(n + 1 )t~ n y(t) -2 n t~ n+l yf ( t ) + t~ n+ 2 y" (t ) . 

Therefore, 
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t 2 w" (0 + tW ( t ) + (t 2 - n 2 )w(t) 

= r" +1 (r/ (t) + (-2n+ 1)/ (f) + ?y(0} = 0. 

We find that y(t) satisfies the differential equation 

ty"(t) - (2n-l)/ (f) + ry(r) = 0. 

This differential equation is solved by means of Laplace transformation. By applying the 
known operational properties: 

tf (t)n-m - A {,2 Y(s) - sy(0 +) - / (0 +)} 

= -2«r(f) - y r («) + y(0 +) , 

- (2« - 1 )/ (0 - - - - (2n - 1) {, F(j) - y(0 +)} 

= -(2n-l)«y(i) + (2n— l)y(0+), 

ty{t)°~* -Y («), 

f /(0 - (2n - 1 )/ {t) + ty(t) 

= - Cf 2 + 1) r (s) - (2 n + 1 )sHj) + 2ny(0 +) = 0. 

Finally, the assumption n y(0 +) = 0 yields 

Y'(s) +(2n+l)-^—Y(s) = 0. 

(s 2 + 1) 

This linear first order differential equation is the image equation for the Laplace transform Y(s) 
of y(t) . If we had tried to directly solve the Bessel differential equation by means of Laplace 
transformation, we would have ended up with another second order differential equation with 
variable coefficients, because the coefficients of Bessel’s differential equation contain second 
powers of t. By contrast, the above first order linear differential equation is readily solved. The 
solution is 



Y(s) = cexp[-(n + yjln(^ 2 + l)j = c (s 2 + 1) 
where c is an arbitrary constant. 

For n = 0, we have 



Y{s) = ■ . 

V S 2 + 1 

Thus, the Laplace transform of the Bessel Function of order 0 is given by 

Jo(t) ° - ■ ■ . 

Vs 2 + 1 



The constant factor c will be determined later. Let us now find a power series for y(t ) . By use 
of the binomial series we obtain 
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V (s) = c— (1 + Lf ' 1/2 = 2 r ~ k ll2 V 2k 



k = 0 



-zrvv'-*"-' 



*=o 



The binomial coefficient can be transformed as follows: 



t—n - 1 /2\ _ (-n -1/2) (-n -3/2) ... (— n - A: + 1/2) 
V k fc! 

*. (2n + 1) (2n + 3) ...(2rc + 2fc-l) 

- <-* ?*i 

(-1)* (2 n + 1) (2 n + 2) ... (2 n + 2 fc - 1) (2 n + 2 £) 

” 2* fc ! (2 n + 2) (2 n + 4) ...(2n + 2k) 

(~\) k (2n+l)(2n + 2)...(2n + 2k-l)(2n + 2k) 

~ 2*fc!(2*(n+l)(n + 2) ...(n + k)) 

(-1)* (2n + 2k)\n\ 

~ 2 k k\ (2 ri) \2 k (n + k)\ 

( -1)* Y(2n + 2k+ l)T(n+ 1) 

“ 2 2k k\ r(2n + l)r(« + )t+l) ' 

Hence we have 



Y(s) = 



c 

(a“ + D n+1/2 



r(w + 1) y ( -i) k 

C Y(2n + 1) Z. J 2 2 * k\ 

k=0 



T(2n + 2k + 1) 
T(n + k+ 1) 



1 

^ 2 (n+ £)+ 1 



By taking the inverse Laplace transform term by term (expansion theorem of the first kind), we 
obtain 



r(n+l)2" y (-1)* r(2n + 2£ + 1) t 2( - n+k) 

y{f ’ ~ C T(2n+ 1) 2—i 2 2k+n k\ r(n + )t+l) T(2n + 2k+ 1) ' 

k = 0 

The function y(t), being the solution of a homogeneous linear differential equation, is only 
determined up to a constant factor. We now choose c such that 

^ T(n+ 1)2" 

C Y(2n+ 1) 1- 

Finally, this gives the power series of the Bessel Function of order n 



Jn(t) = 



r n y{t) 



oo 

-Zf 

k=Q 



(~i r 

Y(n + k + 1) V 2 



(iJ 



2 k + n 



(1.27) 



Also, we obtained the correspondence 
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f Jn(t) ° - 1 



T(2n + 1) 



2 n T(n + 1) ( 5 2 + if+W 



r(n+|) 2” 

yfii 



1 

(* 2 + iy 



n+1/2 



(1.28) 



The latter two formulas were derived for a positive integer n, but it can be shown that they are 
still true if n is replaced by a complex number v, provided Rv > -1 / 2. The Bessel functions 
describe some damped oscillations as is shown in the graphs of Figs. 1.9 and 1.10. 



Jo (x) 




Fig. 1.9: Bessel Function of order zero. 
Ji (x) 




Later in Section 6.2, it will be shown that for large values of t the following asymptotic 
expression holds: 



/ 2 / Tin ji \ 



If n = 0, we have c = 1 . Thus, 



/o(0 Q --— L=r. (L29) 

Vs 2 + 1 

If n = 1 , we also have c = 1 . Moreover lim f _,o+ y(t)/t = J\(0 +) = 0 exists, hence the image 
integration rule can be applied: 
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= z« a _. r i 

t Js (s 2 + 1)‘ 



f s 2 + 1 -s 



The Bessel Functions J n {t) satisfy the recursion relation 
- J n+l (t) = 2 J n ' (t) 

which follows from (1. 27). Because/^ (0 +) = 0 for all positive integers n, we obtain, by the 
differentiation rule, the recursion relation for the image functions 

£J n -i(s) - £J n+i (s) = 2s £J n (s ) , 



£J n +i(s) = £J n -i(s) - 2s£J n {s\ (n = 1, 2, 3, ...). 
This can be used to find 



£J 2 (s) = £J 0 (s) - 2s£J l (s) 



1 2 5(V s 2 + 1 - 5 ) 



1-25 Vs 2 + 1 -2 s 2 [ Vs 2 + 1 - s 



hit) ° - 1 



[V* 2 + 1 



Repeating this process 



£J 3 (s) = £h(s) - 2s£J 2 (s) 



1-5 [V*5 2 + 1 - s] 



( V J 2 + 1 - 5 ) (l - 2 5 Vs 2 + 1 - 2 5 2 ) V s 2 + 1 -s 



and so on. The general result is 
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Jn ( t ) ■-! 



[Vs 2 + 1 - s] 



Vs 2 + 1 [Vs 2 + 1 + s] n 

We conclude this section by deriving a representation for the Bessel function as a Laplace 
integral. This is done by use of (1.28) and the convolution theorem. We write for Rn > - 1 / 2, 

Vn f J n (f) 1 1 1 

2" T(n + y) (s 2 + l) n+1/2 (s + 0" +1/2 U - i) n+1/2 ' 

Therefore, the correspondence 



(s±i) n+1/2 T(n+ 1/2) 



and the convolution theorem yield 



f j„(t ) i r 

2«r (n+|) r 2 (n+|)Jo 

By substituting jc = f m , we have 



f (r-x)"- 1/2 ^' (, - A) ^~ l/2 e ,x dx. 

+ i) Jo 



Vn r(n + y) 2-” e" f" 7„(r) = jT e 2ix (f - xf 

= f 2 " f l e 2i ‘“(l-u) n - 1/2 u n - 1/2 du. 

Jo 



- 1/2 1/2 



x n ~ l/z dx 



By another change of variables w = (1 - a>)/2, 1 - u = (1 + a))/ 2, we obtain 



yy r(n + i) 2 -" c" r" /„(f) = 



(1 - or) rfv 



and, finally, 



y^ r(n+|)2" r tt j n (t)= J^e iu 



/i 2 t/2 _ 

(1 - or) aw 



which is the representation of the function in the left-hand side as a finite Fourier integral. Yet 
another substitution cj = r- 1 , 1 - oj 2 = 2 r - r 2 and by setting r = s exp(/ n 12) , yields 



1 f' 2 

y^F r(n+ y]2" s~" e~ nn/2 J n (se inl2 )= e s J e~ s ‘ 



[ r (2 - r )]"- 1/2 dr . 



This can also be regarded as 

»(2 — 0 [ t (2 - r )] n ~ 1/2 
yfn r(n+i)2" 



s~ n e~ s e~ nin/2 J n (se inl2 ). 
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Since e W7r/2 J n (s e in/2 )=\ I n (s) for -n < args < n / 2 , we also have 



u ( 2 - 1) 

V^r T(n + 4-)2 n 



[t(2-t)] s- n e-I n (s) 



with the modified Bessel function I n (s ) . 



Problem 1.18. Prove that 



d / Jn(f) \ _ Jn+l(f) 
dt V t n / t n 






Problem 1.19. Prove that 



Jnit) = ^J n {t)-J n+X (t\ J n '(t ) = 7 n _iW- jJ n «). 
Problem 1.20. Show the two recursion relations 



Jn-l (f) + Jn+l (f) ~ j Jn-l if) Jn+liO ~ ^J n (t) . 

Problem 1.21. Show that Jo' (t) = - Ji(t). 

Problem 1.21a. Use (1.32) for non integer values of n, to show that 



s 2 + 1 - s 



J-l/lit) 



s 2 + 1 + 



and compare these relations with the result in Section 1 . 1 .3.2. 

Problem 1.22. Use the power series expansion of exp[-&/s] /s 0 ^ 1 , the term by term Laplace 
inversion, and (1.27) to show that 



1 . * .a/2 

— e~ bls m-uy-A J a ^yfbt), (6 > 0, a > -l) 



Problem 1.23. Show that 



s(2 yfbl) 



1.1.3.4 The Error Function and Related Correspondences 



The Error Function and the Complementary Error Function are defined as 



erf(0 := 



hi’" 
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erfc(0 := 



2 

Vtt 




du . 



Because 




we have the identity erfc (t) = 1 - erf(r). The following important integral is related to the 
Complementary Error Function: 




This follows from the definition of erfc by a change of variables. For b - s/2, c = 0, we 
obtain 



r-— = i/f exp (£H 177 ) 



with a > 0, hence 



exp[- at 1 ] ° ■ 4- / — expf erfcf — 1 a > 0 . 

2^ a v \Aa) { 2 



In Problem 16 we found the correspondences 



1 

V7 {V7 + b) 



° e ^ 1 erfc(& \[t ) , 



—J- _1 - be b2t erfc(& yft ) . 

ys +b ynt 

We wish to use (1.18) to find the inverse transform of exp [-a^fs]/s. The correspondence 
F(^) = exp [-0 s] / s ■ - D f{t) - u(t - a) implies 



f[V 7] exp [-a V7] 

V7 yfs 

expf - a V71 1 

= ■ - □ 

s y[nt 




u(r-a)dT 



1 

yfnt 

Ut_ 

^fnt 




erfc 



a 

ui: 



Finally, 
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exi 



;p[-a V7] 



i - ° erfc 



a 



2VJ. 



Problem 1.24. Use the formula of Problem 13 to show that 
exp [-a yfs] exp [-a 2 / (4 t)] 



V7 



■ 1.1.4 Inverse Laplace Transforms 



1.1.4.1 The Inverse Laplace Transform of Rational Image Functions 

The inverse Laplace transform of a rational image function is of great importance because 
rational image functions often occur when ordinary differential equations are solved by means 
of Laplace transformation. A rational image function is the quotient of two polynomials Q(s) 
and PCs). Let the degree of the numerator polynomial Q(s) be m and the degree of the 
denominator polynomial P(s) be n . A rational function is called a proper rational function if 
m<n. Any rational function F(s) with m > n can be written uniquely as the sum of a 
polynomial and a proper rational function: 

17/ \ JC JC~ 1 GW 

F(s) = a k sr + a k - i / + ••• + a 0 + — — 

P(s) 

( k-m-n , degree Q < degree P). 

Due to the linearity property, we shall be able to find the inverse Laplace transform of any 
rational image function, provided we can transform back a power s k , the constant 1 , and a 
proper rational image function. We have already noted that the originals corresponding to a 
power s k , including the case k = 0, cannot be regarded as ordinary functions. The concept of a 
function must be extended in order to prepare the field for polynomial image functions. In this 
section we shall only treat the problem of finding the inverse Laplace transform of a proper 
rational image function. This will be accomplished by means of a partial fraction 
decomposition of the proper rational function. For doing so, the given denominator polynomial 
P(s) needs to factor completely into linear factors: 

P(s) = (s- a\) Vl (s - a 2 ) V2 ••• (s - a p ) v ? (1.36) 

where a\ , . . . , a p are the p mutually different complex zeros or roots of P(s) , i.e. 
or i , . . . , a p are all the mutually different solutions of the algebraic equation P(s) = 0. We 
also assume that the leading coefficient of the denominator polynomial P(s) is 1. The 
Fundamental Theorem of Algebra ensures that any polynomial can be written uniquely in the 
form (1.36). However, if the degree of the polynomial is higher than four, the zeros can 
generally only be determined numerically. But even in the case of degree three or four, closed 
formulas for computing the zeros are unhandy, so that they are rarely used. The positive 
integer exponent v, associated with the complex zero a t is called the multiplicity of the zero 
cti . If the multiplicity is 1, we call it a simple zero. Clearly, 



vi + V 2 + ...+ v p = n = degree of P . 

Most polynomials encountered in applications have real coefficients. We call a polynomial 
with real coefficients a real polynomial (even if its variable s varies over the complex plane). 
In general, a real polynomial can have real and complex zeros. But the nonreal complex zeros 
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always occur in pairs, i.e. if or, is a nonreal zero then its complex conjugate is also a zero. 
Thus the decomposition into linear factors of a real polynomial can be written as 

m = (j-f i) yi (s-f 2 r... (s-trY' 

[(i-a 2 )(i-o 2)]^ (1-37) 

... [(s-ac)^-^)]^ 



where , . . . , g r are the r mutually different real zeros and ct\, . . . , a c the c mutually 
different pairs of nonreal zeros. Clearly, 

v\ + V 2 + + v r + 2(/ii + ji 2 + •••+ p c )= n = degree of P. 

We shall state, without proof, the theorem of partial fraction decomposition. 

Proposition. Any proper rational function 

m = m. = m 

P(s) (s - ai ) Vl - a 2 ) V2 ...(s- a p ) Vp 

can be written as 



p 

r 



Ur- 



«kl 



«k2 



k=l 



a k r (s - a k ) 



,v*-l 



+ 



^kvi 

(s - a k ) 



(1.38) 



where the complex coefficients a^, are uniquely determined by F(s). In the case of a real 
proper rational function (a quotient of two real polynomials), the decomposition into partial 
fractions takes the form: 



F(s) = 



Q(s) 



Q(s) 



P(s) (s-f,) y ' ...(s-f r r 

1 

[Cs-aiXs-aDF 1 ••• [(s-Q' c )(i’-57)] ,i ‘ 



vr *ki 



'Ur 



b\2 



lc=l 



&r k (s-{ k y 



>v*- 1 



frkn 

(*-&). 



+ 




^kl 

(s - a k ) n 



+ 



Qkl \ 

(s-m) Vk > 



+ 



| flkvi + a kvi Y\ 

\(s- a k ) (s - at) /J ' 



(1.39) 



Note that the coefficients associated with conjugate zeros are also conjugate and the 
coefficients associated with real zeros are real. Next we wish to compute the coefficients a & in 
( 1.38). Let us consider a fixed index me{l,2, ... , p). The reduced rational function 



F m {s) := F(s)(s-a m T 



Q{s){s-a m )^ Q(s) 

P{s) P m (s) ’ 



where 



P m (s) := (s -Q'l)*' 1 ... (?- a m -i ) Vm -' (s - a m+ i) iw ' . . . (s - a p f’‘ , 
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obtained from F(s) by omitting the factor (s-a m ) Vm in the denominator, is holomorphic at 
s = a m and, therefore, can be expanded into a Taylor series about s = a m . 



Fmif) ~ c m\ + Cm2( s a m) + C m 3(5 ®m) + 



(1.40) 



with 






(1.38) yields 



F m (s) = 



GW (s - a m ) v 
P(s) 



— #mi + a^is cx m ) + ••* + <z mVl ( s cx m ) m + 

p 

( \ v m \ | a kl a k 2 a kV] 

(s-a m ) m > I- —+ — r + -** + 






* = 1, (£ £m) 



* (-S “ a k) 



v *— 1 



(s - or*) 



The last term on the right-hand side is of the form ( s - ct m ) Vm h(s ), where the sum h(s) is a 
holomorphic function at s = a m . Thus 

(s - a m ) Vm h(s) 

= (s — Ctrn) m {ho + hi(s - + 1l2 (s — CX m ) + • • •} 

= h 0 (s - a m ) Vm + h x (s- a m ) Vm+ 1 + ••• . 



Therefore, the Taylor expansion of F m (s ) is 



F m i s ) ~~ ^ml + ^m2 Gf/n ) + * * * + ^mvi (* y ) + 



+ ho (s - a m ) m + hi (s - a m ) m +•••. 

The Taylor expansion is unique. By comparing the expansion (1.40) and (1.41) we see that 



(1.41) 



1 ( <?- 1 \ „ 
a m 1 “ 7* TTT I j_i C 5 ) I > i — 0, 1 , 2, 

0 - 1) ! V ds 1 Js = a m 



... v m - 1. 



(1.42) 



The first three coefficients in the partial fraction decomposition (1.38) are 
Z7 /_ \ Q(@m) 

^ml — 7 m [(X m ) — . v » 

r, „ ^ _ d ( GW ) 
flm2 m (am) “ * (p.rji) 



^m3 — 



AVPmWW 

F m '(a m ) = / GW \ 

2 2 *2 Vp m(s )J i=a / 



and so forth. 



In the case of a real rational function (1.42) implies 
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1 



0-D! 



£_ 

dr 




1 ( d [ ~ x 

O'-D! 




^mi 



yielding the representation (1.39). This means that in the case of a pair of nonreal complex 
zeros, only one coefficient a m , has to be computed, while the coefficient corresponding to the 
conjugate zero, is simply the conjugate complex value of a mi . Remember that this is only true 
for real rational functions. 



The partial fraction decompositions (1.38) and (1.39) indicate that all that is needed to compute 
the inverse Laplace transform of a given proper rational image function, are the following two 
correspondences: 



1 

(s-a) k 



| — □ ? 



I — □ ? 



(5 - ay ( s - ay 



In the first correspondence the zero a can be real or nonreal, in the second one, we assume that 
a is nonreal. By use of 



1 

s k 






(fceN) 



and the image shift rule, we immediately obtain 



1 






(s-a) k (*-l)! 



(*cN) 



which is correct for real or nonreal a. A real partial fraction 
— - (a e (R, £elR) 

will always produce a real-valued original function: 
a 



(s-tr 






e R. 



The pair 



(1.43) 



a a 

(s - a) k (^ - a) k 

will also produce a real-valued original. We set for the nonreal zero 
a = k + i (j) (^eR, a) > 0) 

i.e. k is the real part and w is the imaginary part of the nonreal zero a. The complex 
coefficient a can be represented in cartesian or in polar coordinates: 

a = A + Bi= re i<p , 

(A, Be IR, r = | a \ > 0, ip = arga e R) 

(r = V A 2 + B 2 , A = rcosy?, B = rsin^) 

We now have 
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a f*- 1 e a ' 

{s-af m ~° a D! 



(A + Bt) 



fk - 1 + 



= (A + £/) 



t* 1 e Kt (cos f + i sin 0 
(A:- 1)! 



and similarly 



I - n - 



ft 



= (A - B i) 



fk - 1 e (K-iu))t 



(s - a) k " ik- 1>! (k- 1)! 

f* -1 e Kt (cos of - i sin co t) 

<TT>! • 

Thus, by linearity, we obtain the desired correspondence 



a a 

+ 



(s - a) k (5 - a) k 

flc-l t 

= 2 - — — rcos(cot + ip ). 
(k- 1)! 



tk-i ^ t 

1 - ° 2 — — tt-t {A cos ot - B sin u> t] 



(k~ D! 



(1.44) 



For the special case of a pair of simple zeros one obtains 



+ — ■ - D 2 e Kt {Acoscjf - 2?sin<x>f} _ 

s-a s-a (1.45) 

= 2 e Kt rcos(a)t + ip) 

with no powers of t. If the zero has a higher multiplicity, powers of t come up in the 
corresponding original. A pair of simple and nonreal complex conjugate zeros of the 
denominator polynomial yields an increasing harmonic oscillation, a stationary harmonic 
oscillation, or a damped harmonic oscillation, depending on the common real part k of the 
zero: positive, zero, or negative. In any case, a real or a nonreal zero a of the denominator 
polynomial will produce an exponentially decaying term for t -» 00 , if and only if, the real 
part of this zero is strictly negative, i.e. is located in the negative complex half-plane. A pair of 
complex conjugate nonreal poles located on the imaginary axis will produce a stationary 
harmonic oscillation with a constant amplitude if the poles are simple. If the poles have a 
higher multiplicity, the oscillation will have an amplitude which grows up with a power of t. A 
pole located in the right complex half-plane will always produce a term which is exponentially 
growing for t -» 00 . 

Example. 



v ' s 2 (s+l)(s 2 + 2s + 5) s 2 (s+l)[s-(-l+2i)][s-(-l-2i)] ’ 

This is a proper real rational image function where 5 = 0 is a pole of order 2 (a zero of 
multiplicity 2 of the denominator polynomial), s = - l is a simple pole, and s = - 1 + 2 i is a 
pair of complex conjugate poles. The partial fraction decomposition has the following form. 



F(s) = 



#11 + a 12 + 32 

S 2 S 5+1 



+ 



031 

[s- (-l+2i)] + 



031 

[s-(-i-2or 




40 



Chapter 1 



Fi(s) = 



s + 3 



(s+l)Cs 2 + 2s + 5) ’ 
an = Fj( 0) = 3/5. a n = Fj'( 0) = -16/25, 

F < \ - * + 3 

2W “ J 2 ( S 2+ 2s + 5) ’ 
a 2 = F 2 (-l) = 1/2, 

F,(,) = 

i 2 (j+ 1 )[i-(-l+20] ’ 

a n = F 3 (-l-2i) = (7 - /)/ 100 =* a^ = (7 + 0/100. 



Finally, 



m = + I*" + 



cos 2 1 + _ 

100 100 



sin 2 1 1 . 

00 J 



5 25 2 

Problem 1.25. Find the original corresponding to the rational image functions 
1 1 



2 * 



■S (s + 1 r (s 2 + 2 5 + 5) J (s + 1) (s 2 + 2 5 + 5) 

An important special case is the situation where all zeros (real or nonreal) of the denominator 
polynomial are simple. The rational image function can then be written as 



F(s ) = 



Q(s) 



Q(s) 



P(s) (s - a x ) (s - a 2 ) . . . (s - a n ) 
The decomposition into partial fractions is simply 



FU) = t — 

" s-a m 



(1.46) 



(1.47) 



The reduced rational function F m (s) becomes 



F m (s) ■- F(s) (s-a m ) = 



Q(s)(s-a m ) 

Pis ) 



QU) Q(s) 

PM PM-P(a m ) 

(s-a m ) ( s-a m ) 



since P(a m )= O.But 






= F m (a m ) = lim F m (s) = lim 

s-*a m s-*a m 



Q(s ) 

P(s)-P(a m ) 
( s-a m ) 



6(«m) 

P’ (a m ) ’ 



Therefore 



FU) = £ 

m= 1 



Qfen) 1 

P' (&m ) $ ~ &m 



° /« = Z 

m= 1 



Q(a m ) , 
P’ («m) ^ 



(1.48) 



1.1.4.2 Inversion Formulas 



The Laplace transform F(s) of the original f(t) is defined by 
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F(s) := £° e~ sl f(t)dt. 

The question arises whether there is a similar formula which gives the original fit) as a 
function of its image F(s). There are even several. The most important is the Complex 
Inversion Formula. Another one is the Post- Widder Inversion Formula which looks like this: 



If/(r)o-« F(s ) , then 



fit) = lim 

n-* oo 




s" +1 

~n\ 




s = (n+l)/t 



In the case where fit) has a discontinuity of the first kind at t, the left-hand member has to be 
replaced by { fit + 0) + fit - 0)} / 2 . 

Example. 

FW = AL, * 6N . 

We have 



(-1)" F <n) (s) 



(k + n) ! 

^.fc+n+1 



s n+ i 

(-1 r —rf< n) (s) = 



(k + n) ! 
s k n ! 



and then 






* = («+!)// 



(b+1)(b + 2). ..(» + *) j . 

frTTi? f 



(k + n)\ ^ 

(n +l)‘n! 






= m (b -» oo). 



For analytical work the Post-Widder Inversion formula had little impact despite the fact that a 
natural probabilistic interpretation can be given to it. Today however, this inversion formula is 
the starting point for an important method for the numerical inversion of a Laplace transform, 
the Post-Widder-Stehfestalgorithm (see Chapter 11). 



The most important inversion formula is the Complex Inversion Formula It is based on 
Fourier's Integral Theorem which belongs to the realm of Fourier series and Fourier 
transforms. The Complex Inversion Formula is 



m 



j r*c+i oo 

= ■= — rpv I e ,s F(s)ds, 

2?r« J c _ ioo 



(1.49) 



where the symbol pv stands for Cauchy’s principal value of the integral. This means 

c+ib 



£ +i oo rc+i b 

e ts Fis)ds := lim I e ts 

i oo b-*oo j c _- ^ 



Fis)ds. 
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The integration contour is the vertical path s = c + iy, -oo < y < oo which must be wholly 
located in the right half-plane of convergence of the given image function. In the case where 
fit) has a discontinuity of the first kind at t, the left-hand member has also to be replaced by 

fit + 0) + fit - 0) 

2 

The Complex Inversion Formula is seldom used directly. The formula serves more as a starting 
point for various procedures based on methods from the domain of functions of a complex 
variable. Since this first chapter is being thought of as a straightforward introduction to the 
method of Laplace transformation, we do not go further at this point and postpone the methods 
based on the Complex Inversion Formula to a later chapter (see Section 6.1). 



1.2 The Two-Sided Laplace Transform 



The two-sided Laplace transform is a generalization of the ordinary or one-sided Laplace 
transform. The two-sided Laplace transformation is extensively covered in [Van der Pol B. and 
Bremmer H. (1987)]. Also see [Doetsch G. I (1971), II (1972), III (1973)]. 



■ 1.2.1 The Two-Sided Laplace Integral 

Remember that an original function is a function defined on (R and which is vanishing on the 
negative part of the real axis. Explicitly an original can be written in the form u{t) fit ) where 
uit) is the unit-step function and fit) is a functional expression. In the context of ordinary (one- 
sided) Laplace transformation, we adopted the convention that we drop the factor uit) and 
write simply fit) for the original uit) fit ) . This convention is now lifted. In the context of two- 
sided Laplace transformation, a given function fit) is defined on R and does not necessarily 
vanish on the negative part of the real axis. If we refer to an original function, we will always 
denote it explicitly by uit) fit) when working in the field of two-side Laplace transformation. 

Definition. If fit) is a complex-valued function defined on the entire real axis, we call the 
function of the complex variable s, 

Fis) := f e~ st fit) dt (1.50) 

— oo 

the two-sided Laplace transform of fit), provided the integral exists. We use the following 
notations: 



/(r) ■ F(s), F(s) = £ 2 [/(f)] (i), /(f) = Zj'lFCs)] (r). 

It is clear that the two-sided Laplace transform of an original u(t) /(f) is the ordinary Laplace 
transform of /(f): 



F(s) 




u{t) fit) dt = 







or -£ 2 [«(f)/(f)] (s) = /[/(f)] Cv). 



We can write 
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F(s) := e~ st f(t)dt 
J — OO 

r > 0 /*oo 

= I e~ st f(t)dt + I e~ sl f(t)dt. 

\J — OO Jq 

The first integral on the right-hand side can be expressed as 

I e~ st f(t)dt = I = r e s ‘f(-t)dt. 

J — OO o OO Jo 

If we introduce the two ordinary (one-sided) Laplace transforms of f{t) and fi-t), 

r s^oo 

e-°‘f(t)dt, FAs) ■.= e- s ‘f(-t)dt, 

Jo 

respectively, we can write 

F(s) = F.(-s) + F + (5). 



(1.51) 



Assume that F_ ( 5 ) has the right half-plane of convergence Rs > - c_ , i.e. the ordinary 
Laplace integral exists and defines a holomorphic function in this half-plane. This implies that 
the domain of F.(-s) is the left half-plane Rs < c_ Assume further that F+(s) has the right 
half-plane of convergence Rs > c+ . If c + < c_ the two half-planes have a non- void inter- 
section which is a vertical strip in the complex plane. In this case, and only in this one, the two- 
sided Laplace transform 

F(s) = F-(-s) + F + (s) 

exists for c + < Rs < c_ and is a holomorphic function in this vertical strip of the complex 
plane. The vertical strip c+ < Rs < c_ is called the strip of convergence of the two-sided 
Laplace transform F(s) .If c + > c_ there is no two-sided Laplace transform of fit) . If c+ = -00 
and c_ = + 00 , i.e. - c_ = - 00 , the strip of convergence becomes the whole complex plane. 
When working in the context of the ordinary Laplace transformation it is seldom necessary to 
keep track of the various right half-planes of convergence which can come up in a problem. 
The reason is that an intersection of infinite right half-planes is again an infinite right half- 
plane. In the context of two-sided Laplace transformations however the situation is not so 
comfortable. We have always to keep track of the various strips of convergence in a problem. 
First, because intersections of strips of convergence can become void and second, as we will 
seen later, the same functional expression F(s) can be associated to different strips of 
convergence and can thus correspond to different functions fit ) . 

Example. The function fit) = exp i-a t 2 ) is non-zero on the entire real axis. For a > 0 we can 
compute the two-sided Laplace transform by use of (1.50). We obtain 



e 



-at 2 



□□ 




— OO < Rs < OO. 



We can also use (1.51). Since 



w(/)exp[- at 2 ] ° 




= F + is) 
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u(t) exp[- a(- t) 2 ] ° 




= F-(s) 



thus F+(s ) = F-(s ) with c+ = -oo and -c_ = -oo. Therefore we have for c+ < fts < c_ , 
F(s) = F-(-s) + F + (s) 




because the term in the curly braces is equal to 2, which results directly from the definition of 
the Complementary Error Function. This is an example where the domain of a two-sided 
Laplace transform is the entire complex plane. 



Example. The following function also is non-zero on the entire real axis. 

,,i ( e ~ at , t> 0 

,<o <“ >0) ’ 



U(t) f(t) ° - I 



1 



s + a 



= F+(s), ft s>-a. 






1 



s + a 



= F_(,s), fts > -a , 



F(s) = F_(-.s) + F + (*) = — + 1 



2a 



-s + a s + a s 2 - a 2 



, -a < fts < a . 



Therefore, 



e a I'l □□ _ ■ , -a < fts < a . 

s 2 - a 2 

This is an example of a two-sided Laplace transform with a strip of convergence of finite 
width. 



Example. The following function also is non-zero on the entire real axis and has the Gamma 
function as its two-sided image. 

fit) = exp[- e~ l ], 

exp[- e~ l \ dd - ■ F(s) = j e~ st exp[- e~ f ] dt . 

—OO 

A change of variables x = e~ 1 <==> t = - In x gives 

X oo r*oo 

e~ st exp[- e~ { ] dt = I e~ x x?~ l dx = T(s), fts>0. 
oo Jo 



Therefore, 

exp[- e~*] °° - ■ r(s), fts>0. 
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This is an example where the strip of convergence is a right half-plane. 



Two-sided Laplace transforms and Mellin transforms (also see [Doetsch G. I (1971), II 
(1972)]): The two-sided Laplace transform and the Mellin transform are closely related. Let us 
make the change of variables t = - In x in the two-sided Laplace integral. 



F(s) 



= I e st f(t)dt = | e s lnx /(- lnx ) — - dx 

— oo O oo % 




/(- \nx)dx. 



This is the Mellin transform of the function g(x) := /(-lnx). An introduction to Mellin 
transforms can be found in [Davies B. (1978)]. If we denote a Mellin correspondence by 



fix) " Fiz) 




zF 1 fix) dx := M[fix)] (z ) , 



we can say 



fit) °° - ■ Fis) => gi x) := /(- lnx) ^ G(z) = F(z ) , 

M 

fix) -» Fiz) => git) := /(<;“') - ■ Gis) = Fis). 

For the Mellin transformation there exists large tables of correspondences as it is the case for 
the ordinary Laplace transform. These tables can sometimes be used to obtain two-sided 
Laplace transform correspondences. For example the Mellin correspondence 



1 + x sin n z 



yields immediately the two-sided Laplace transform correspondences 

1 7t ^ 

□□ _ ■ — , 0 < Rs < 1. 

1 + e~ * sin Ji s 

The two-sided Laplace transform of a right-sided function: We call a function /(f) defined on 
the entire real axis a right-sided function, if there is an x such that fit) is vanishing for all 
t < x. The interval [x, oo) is called the support of /(f). An original function is a special case of 
a right-sided function where x = 0. We can represent a right-sided function by w(f-x)/(f). 
The two-sided Laplace transform of a right-sided function in the case where x < 0 is: 



u(t - x) /(f) ■ F(,s) := j e st u(t-x) /(f) dt 

O — OO 

= r e- s, fit)dt= I e- sl fit)dt+ r e- s, fit)dt 

Jx Jx Jo 



-£■ 



Jo 

r*—x 



e“ fi-t) di-t) + £[fit )) (5) = f V fi-t) dt + £[fit)] is) 

Jo 

= FA-s, -x) + £[fit)](s) 



where 
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F_(j, b) := I /(-r)<*r (6 > 0) 

Jo 

is the finite Laplace transform of f(-t) . Finally, for x < 0 , 

u{t - x) f(t) « - m £[f(t)] is) + F-(—s, -x) . (1.52) 

Because an ordinary Laplace transform has a right half-plane of convergence and since a finite 
Laplace integral is always an entire function, the strip of convergence of a two-sided image of 
a right-sided function is always a right half-plane. 

Example. /(f) = f 1 , -oo < t < oo. 

F '+<*> = ^T’ Rs > °’ 

= Rs > 0 ’ 

F(s) = F-(-s) + F + (.) = (-1)" ^ = 0 

but Rs < 0 and Rs > 0 ! Thus there is no strip of convergence and the two-sided Laplace 
transform of a power or of a polynomial in t does not exist. 

After these few examples we define now a class of functions for which the two-sided Laplace 
integral will be convergent, even absolutely convergent. 

Definition. A function /(f) is of bounded exponential growth as t -> oo , if some constant cr’ 
exists such that exp(- <x’ t) \ fit) \ is bounded for all t greater than some finite positive 
number T\ , i.e., for some positive constant M\ , 

|/(0I ^ Mxe*' 1 Vt>T x >0. (1.53) 

Let (T\ be the greatest lower bound of all constants cr’ which satisfy (1. 53). This means that 
for every cr 9 slightly greater than cr\ (1. 53) is satisfied, but for a cr ’ smaller than cr\ (1. 53) no 
longer holds. We call cr\ the growth index of fit) for t oo . 

Similarly, a function fit) is of bounded exponential growth as t -> - oo , if some constant cr’ ’ 
exists such that exp(- <x” f) | fit) | is bounded for all t smaller than some finite negative 
number T 2 , i.e., 

| fit) | < M 2 e a ” ' Vt<T 2 < 0. (1.54) 

Let cr 2 be the least upper bound of all constants cr” which satisfy (1. 54). Thus for every cr” 
slightly smaller than cr 2 , (1.54) is satisfied, but for a cr” greater than cr 2 , (1.54) no longer 
holds. We call cr 2 the growth index of fit) for / -> - 00 . 

An original function uit) fit) is always of bounded exponential growth as t -> - 00 with 
cr 2 = + 00 . 

We say that a function fit) is of two-sided bounded exponential growth , if it is either of 
bounded exponential growth as t - 00 and as t -> 00 . Thus, two growth indices cri and 
cr 2 are associated to a function of two-sided bounded exponential growth. We can have three 
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cases: cr 2 < cr \ , cr 2 = cr \ , cr\ < cr 2 . In order to be able to form a two-sided Laplace transform 
we need the last one of the three cases. But before we show this, let us take advantage of the 
fact that we are here a little bit more theoretical and let us state another assumption that is in 
general always made in the background of the theory of Laplace transformation. 

Generally, it is always assumed that the function f{t) in a Laplace integral is absolutely 
integrable over any finite interval, i.e., 

| f(t) | dt < oo (—00 < a < b < 00). 

It is beyond the scope of this book to bother about this assumption. It is a general technical 
hypothesis needed for the establishment of a logically correct theory of Laplace 
transformation. 




Proposition. A function f(t) of two-sided bounded exponential growth, for which the relation 
cr j < cr 2 is satisfied, is two-sided Laplace transformable . The image function F(s) has the 
strip of convergence o~i <Ks < cr 2 . Here crj is the growth index of f(t) for t -» 00, and cr 2 is 
the growth index of f(t) for t -» -00 . Moreover, the Laplace integral is absolutely and 
uniformly convergent in any sub-strip crj < a < Rs < (3 < cr 2 . 

Proof Let &\ < a < Rs < P< ct 2 and let or’ and /?’ such that cr\ < a' < a and 
p < fT < cr 2 . We then write 



r e ~ st fit) dt = f Tl e~ st f(t)dt + f Tl e-*‘f(t)dt+r e~*‘ 

— 00 — 00 Jt 2 ^ t 1 



mat. 



The integral in the middle is a finite Laplace integral which exists and represents an entire 
holomorphic function of s in the entire complex plane. For the first integral we have the 



P \e~ s, m\dt 

00 

= jV Rs( 1/(0 



dt < e Rs ' M 2 e@ 1 dt 

o — 00 



= M 2 f 2 dt = 



,-(Rs-/3’)f \ t 2 



( r * - n 



£(/?’- Rs )T 2 _ q 



M 2 



This estimate is valid for all s with Rs < p<cr 2 (remember T 2 < 0 ). This shows that the first 
integral has the left half-plane Rs < P as strip of uniform and absolute convergence. The 
estimate for the last integral is similar: 



r \e~ st f(t)\dt 

= J°° <T Rs< i/(0 



1 fit) 1 dt < 



e~* s ‘ Mi e a ’ ' dt 
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r ( .-(Rs-or ')t \ a 

0 _ c -(Rs-a’)r, M 

= — — < 1-r . 

-(Rs - a ) a- a 



This estimate is valid for all s with Rs > a > cr\ (remember T\ > 0). This shows that the last 
integral has the right half-plane Rs > a as a strip of uniform and absolute convergence. The 
intersection of the left half-plane of the first integral, the entire plane of the middle integral and 
the right halt-plane of the last integral gives the strip of uniform and absolute convergence 
<j\ < a < Rs < P < cr. □ 



Remark. In the case of an original function u(t)f(t ), where fit) is assumed to be of bounded 
exponential growth as t -> oo , the condition cr\ < Rs < oo is always fulfilled and the ordinary 
one-sided Laplace integral converges absolutely and uniformly for all s in the right half-plane 
cr\ < a < Rs. 



There are functions which are not of bounded exponential growth and for which the Laplace 
integral has still a non- void strip of convergence. There are other examples of functions which 
have only a strip of simple convergence. In other words the class of Laplace transformable 
functions (or originals) is wider than the class of functions (originals) of bounded exponential 
growth. But the task to prove properties, for example operational rules, for the widest class of 
Laplace transformable functions can be difficult and needs subtle and sophisticated 
mathematics. It is not the aim of this book to go in this direction. For a reader interested in 
accurate and sophisticated formulations of theorems and their proofs, we recommend the 
books of Doetsch, for example [Doetsch (1976)], [Doetsch and Nader (1974)]. For the proofs 
of the theorems in this book we will stay at a more elementary level that consists of assuming 
that the functions are of bounded exponential growth. 



■ 1.2.2 Operational Properties 

1.2.2.1 Linearity 

It is clear that the two-sided Laplace transformation is a linear operator as the ordinary Laplace 
transformation. The two-sided image of a linear combination of functions is the linear combi- 
nation of the individual images. 

1.2.2.2 Integration Rules 

The integration rule for the two-sided Laplace transformation splits into two parts. 

Proposition. If fit) °° - ■ Fis) for cr ; < Rs < <x 2 , then 

— Fis ), max {o’! , 0} < R^ < cr 2 , (1.55) 

,s 

- — Fis) , cr\ < Rs < min {cr 2 , 0} . 

5 



£ 

f 



fix) dx °°-i 
f(x) dx — i 



(1.56) 
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An outline of a proof is : 

If s is restricted to max {cr\ , 0} < Us < cr 2 , then Rs > 0 and we have 

pt poo pt 

I f(x)dx°°-m I e~ st I f(x)dx dt 

xJ — OO xJ—oo xJ — oo 

= || e~ st f(x)dxdt 

\J— oo xj — OO 

SxOO r* OO SXOO poo 

= I e~ st f(x)dt dx = I /(*) I e~ st dt dx 

xj — oo xJ X xJ — CO xj X 

where we interchanged the order of integration in the double integral. Then, 

£ X) /~xOO 

/( jc) I e~ st dt dx 

OO xj X 

£ ( e -st poo Q _ e ~sx 

fix) J dx = J — dx 



since Rs > 0. Now 



X 50 0 ~ e~ sx 1 r° 

/(jc) dx =- e~ sx 

oo -S s 



/(*)<** = — 
5 



The proof for the second rule is similar. □ 



1.2.2.3 The Differentiation Rule 

In the following we assume that the function fit) is differentiable for t < a and for t > a for 
some a , and that the two-sided Laplace transform of /' (t) exists. We allow fit) to have a 
discontinuity of the first kind at t = a . 

Proposition. Let fit) °° - ■ Fis) for crj < Rs < <X 2 and fit) be continuous on the real axis , 
except at t = a where fit) may have a discontinuity of the first kind. Then 

f it) - ■ 5 Fis) - e~ as [fia +) - fia -)}, cr x < Rs < cr 2 . (1.57) 

For an outline of proof, we assume that fit) is of bounded exponential growth with the two 
growth indices cr\ and <r 2 , satisfying the condition cr\ < cr 2 . 

Foro"i < Rs < cr 2 we have 

lim e~ st fit) = 0 = lim e~ st fit ) . 

t->— oo oo 

For, if or and /? are such that <Xi < a < Rs < [i < cr 2 , we have the estimates (1.53) and (1. 54) 

|/(0I < M\ e at Vt>Ti > 0, 

| /(0 I <M 2 e pt V t < T 2 < 0, 

\e~ s, m | = e~*" |/(0 | < M 2 e- ( * s -®‘ 

= M 2 e i0 - ns) ' -> 0 
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for t -» -oo , because fi - fts > 0. Similarly for t -» oo. 

Now 

f'(t)aa- m r e ~ st f (t)dt + f e ~ st f(t)dt 

v/ - oo 

= '(«■"/») - f“ ( s)e- s, f(t)dt 

+ («-"/(*))£"" - r (-S)e- s, f(t)dt 
Jo. 

= e~ sa f{a-) + s ^ e~ st f(t)dt - e~ sa f(a+) + s f°° e~ s ' 

U— oo '-'a 

= - e- sa {f(a+)-f(a-)} + s f° e~ st f{t)dt 

—oo 

= s F(s) - e~ sa {f{a+)-f{a-)}. □ 

If /(r) has discontinuities of the first kind at t = a\, . . . , a n , then the differentiation rule 

reads 



f{t)dt 



f (0 QD ~ F(.y) - ^ a * 5 {/te +) - f(a k -)}. 

k=i 

Observe that in the special case of an original u(t) fit), where fit) is assumed to be continuous 
for all t > 0, the only discontinuity is at t = 0. Furthermore, we have /( 0 -) = 0 and the above 
differentiation rule becomes 

Hit) f it) »- - ■ 3 F(s) - e~ 0s 1/(0 +) - 0} 

= sF(s)-f{ 0+), 

which is the differentiation rule for the ordinary Laplace transformation. 

If the function fit) is differentiable for all t, and therefore continuous for all t, the 
differentiation rule becomes simply 



fit) ■ F(s) => f it) °° - ■ s Fis ) , cr\ < R$ < cr 2 
provided that f it) is two-sided Laplace transformable. 

Example. 




(1.58) 



and by linearity 
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Remark. For functions with bounded exponential growth, the proof above shows that the strip 
of convergence remains the same when the differentiation rule is applied. For more general 
functions, this need no more be the case. The strip of convergence may become wider or 
narrower. In order to apply the differentiation rule 

f(t) F(s ) => f n) ( t ) °°-m s n F(s ), 

in a more general case, under the hypothesis that j* n \i) is two-sided Laplace transformable, 
the following hypotheses should be satisfied: 

/(- oo) = /'(- oo) = ••• = / (n_1) (-oo) = 0 and s is restricted to Rs > 0, respectively, 

/( oo) = /'(oo) = • • • = f n ~ l) (oo) = 0, if s is restricted to Rs < 0. 

For a proof of this, see [Doetsch G. II (1972)]. 



1.2.2.4 The Image Shift Rule 

This rule is similar to the one for the ordinary Laplace transformation, but the strip of 
convergence is translated. 

Proposition. If F(s) is the two-sided image of fit) with the strip of convergence 
cr 7 < Rs < cr 2 , then 

e at fit) °° - ■ Fis - a ), <j\ + Rtf < Rs < cr 2 + Rtf , (1-59) 



Proof 



Fis -a) 



e ( s a)t fit) dt, <j\ < R(s-tf) < cr 2 



which equals 




fit)dt ■- 



□□ e at fit ) , cr\ + Ra < Rs < cr 2 + R<z . □ 



1.2.2.5 The t-Shift Rule 

In contrast to the situation for ordinary Laplace transformation, right and left shifts of the 
function fit) need not be distinguished. The shift constant a may be positive or negative. 

Proposition. If Fis) is the two-sided image of fit) with the strip of convergence 
cr j < Rs < cr 2 , then 

fit -a)°°-m e~ as F(s), cr\ < Rs < cr 2 (1.60) 



Proof 
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fit - a) °° - 




f(t-a)dt 




e ~ $( t+a ) 



f(t)dt = e~ as 




f(t)dt = e~ as 



F(s ) . □ 



1.2.2.6 The Similarity Rule 



Again in contrast to the situation for ordinary Laplace transformation, the scale change factor a 
may be positive or negative. Observe the change of the strip of convergence. 

Proposition. If F(s) is the two-sided image of f(f) with the strip of convergence 
cr j < R.s < (J 2 •> then 



1 /s\ (ao-\ < Rs <a(T 2 , a>0 

^ " | a | v a /’ i a cr 2 < Rs < a (T \ , a < 0 



(1.61) 



Proof fox the case that a < 0 : 

f(at)°°-*r° e~ st f(at)dt - f 

x) — OO OO 

by a change of variables t = x/ a. Then 



- sx/a 



f(x)d(x/a ) ; 



f 

OO 



-- s x/a 



f(x)d(x/a) 



= -ir, 

« J-00 



-sx/a 



fix) dx 



= — L f°° e s,ax f(x)dx= 1 f” e s/ax f(x)dx 
a oo 1^1 J — 00 

= -p-j- )> <Tl < R(— ) < 0-2 ■ 

\a\ \a) \a> 



As a < 0, the last inequality becomes ao-\ > R s> acr 2 . □ 



Example. Two-sided Laplace transform of the Gaussian probability density. The normalized 
Gaussian probability density, corresponding to mean zero and to variance 1 is given by 

(pit) = -L-e'' 2 ' 2 . 

V2 It 

By use of linearity and the correspondence 




we find 



(p(t) = e ** ! 2 na-m e s2/2 . 

y[2^ 

The Gaussian probability density corresponding to mean p and variance cr 2 is given by 
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fit) := — J — -) (o' > 0 ) . 

cr v cr t 

By applying first the similarity rule, then the t-shift rule and finally linearity, we obtain 

(p(t) := — ip( — ) “»-■ 0(5) = — cre~^ s e ~( (rs ') 2 l 2 

cr V cr / cr 

[ 0-2 2 

= expl- -sr-ps 
The strip of convergence is the entire plane. 

1.2.2.7 The t-Multiplication Rule 

This rule is exactly the same as the one for the ordinary Laplace transformation. It reads as 
follows: 

Proposition. If F(s) is the two-sided image of f(t) with the strip of convergence 
a 1 < Rs < cr 2 , then 

f f(t) □□_■(_ if F< n) (sl cr 1 < Rs < o- 2 . ( 1 . 62 ) 

One obtains this rule by differentiating n times under the integral sign of the Laplace integral. 



1.2.2.8 The Convolution Rule 

The convolution of two functions f(t) and g(t) defined on the entire real axis is defined as 







fit - x) g(x) dx. 



(1.63) 



Observe that, if the two functions are originals, we obtain the defining expression of Section 
1. 1.2.9, i.e., 

(u(f)fit)*u(t)fit))it)= f f(t-x)g(x)dx. 

Jo 

Again, one can prove that the convolution product is commutative, distributive and associative: 

f*g = 8*f> f*(8 + h) = f*g + /* h , 

f*(g*h) = (f*g)*h = /* g* h , 

where f*g*h is 



r*o o roo 

( f*g*h)(t) = I I f(t-xi-x 2 ) g(x 1 ) h(x 2 ) dx 1 dx 2 . 

O —00 O —00 



The Convolution Theorem is analogous to the one for the one-sided Laplace transformation. 

Convolution Theorem. If we have f(t)°°-m F(s), o-j < R 5 < cr 2 and g(t) G(s ), 

pi < Rs < p 2 , then 
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( f*g)(t ) aa-m F(s)G(s ), maxfcri, p\} < R.s < min {cr 2 ,p 2 }. (1*64) 

We omit the proof, which again is based on a change of variables in a 2-dimensional integral. 

Example. In the above integral for f*g*h, we take fit) = w(t) and obtain, by the convolution 
theorem with g(t) ■ G(s), cr\ < Rs < cr 2 and h(t) aa - ■ , p\ < Rs < p 2 , 

A »00 /"»00 

(u*g*h)(t) = I I uit -xi -x 2 ) g(x { ) life) dx 2 

—oo*J —oo 

= f f g(xi)h(x 2 ) dx i dx 2 — G'(.v) //(i) 

0 J*i +*2 £ f * 

max{0, o"! pi } < Rs < min{oo, cr 2 , P 2 } = min{cr 2 , p 2 } . 

Example. Euler’s Beta Function. Starting from the correspondences 



1 

— ■ - ° D “(0 tt-t 
, v" r(a) 



1 r*- 1 

T ■ - DD u(f) — — 



Ra > 0, R2> > 0 



s have, by the Convolution Theorem, 



1 r°° {t-xf - 1 jc *- 1 

— I «(/-*) — — — — u(x)——dx 

s a s b J- 00 r(a) r(b) 

r 1 (t- x) a ~ l x?- 1 , 

= wfr) I — — flfjc 



c' d-xr 1 x*- 1 J 
Jo T(a) T(fc) * 

rr “ ( p r , , f (t-xf - 1 x *- 1 dx . 

r(a)T(b) J 0 



On the other hand. 



1 t a+ *- 1 

■ — uit) 

s a+b Tia + b) 



Therefore, 



Tia + b) mm Jo 



r it - x) a 1 jc^ 1 fix. 

Jo 



Or, if we set r = 1 , we obtain 



na+b) mm 



f— f (l-xf 1 J 1 dx. 
)T(fe) Jo 



The function 



Bia , b) 



mm 

Tia + b) 



is called Euler’s Beta function. 

Example. The Reflection Formula for the Gamma Function. We start with the correspondence 
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exp[- e~ f ] °° - ■ T(s), R$ > 0 
and apply the similarity rule with a = - 1 to obtain 
exp[- - ■ T(-5) , Rs < 0 . 

By the image shift rule, 

e* exp[- e f ] °° - ■ T(-(s - 1)) =r(-5+l) Rs < 1 . 
Now we use the convolution theorem. 



T(s) T(-s I exp[- e ( ' x) ] e x exp[- e x ] dx 

v/— OO 

= I exp[x- e~ f e x - e x ]dx , 0 < Rs < 1. 

OO 

A change of variables u = e x yields 

re?) r(-j + 1) ■ - f°° du = — l — od — ■ ~ . 

J 0 1 + e~ f sm7T5 

Therefore, we obtain the relation, called the Reflection Formula for the Gamma Function , 

71 



m r(-s + i) = — 



SUMS 



( 1 . 66 ) 



which we derived under the restriction 0 < Rs < 1 . The relation can be extended to all s by 
analytic continuation. 

Problem 1.26. Establish the correspondence 



exp[- (at 1 + bt + c)] a °- 



71 

— exp 



(s + b? 



4 a 



- c\ 



Problem 1.27. By use of the Mellin transform correspondence 

e ±lt e ±l(<nl2)z T(z) , 0<Rz<l, 
establish the correspondences 

exp[± ie~ t ]°°-m exp|± y i 5-J T(s) , 
COS(^ _ 0 DD “" COS^yjJr(5), 
sin(^“ ') °° - ■ sin ( y r(s) 

with 0 < Rs < 1 . The last relation even holds for - 1 < Rs < 1 . 
Problem 1.28. Use the similarity rule to establish 

1 71 



1 + e* 



□□ — ■ — • 



sin ns 



(-1 <Rs<0). 



-oo < Rs < oo, a > 0 . 
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Problem 1.29. Use the image shift rule, the Convolution Theorem, and appropriate changes of 
variables to establish the Duplication Formula for the Gamma Function 



r(s)r hi) = ^ r(2f) 



(1.67) 



■ 1.2.3 The Dirac Impulse and its Laplace Transform 



1.2.3.1 A Heuristic Introduction of the Dirac Impulse and its Laplace Transform 

We consider the sequence of functions 
n n + 1 

8 n (t- 1) := —-u{f)fe~ nt . 
n ! 

It is easy to see that the peak (maximum value) of S n (t - 1) is at t = 1 for all n. Let us take the 
two-sided Laplace transform of each member of the sequence. By the image shift rule, we get 

6 n {t- l)»-u A n (s) 

n n+1 n ! / n \ w+1 1 / n \ 

n\ ( s + ri) n+l ' s + n / (1 + ±) n \ s + n / 

We can deduct two things. First, 



A„(0) = 





6 n {t-\)dt = 1 



for all n. This means that for all n, we have unit area under the curve of each 8 n (t- 1). 
Furthermore, by Stirling’s Formula, 



In 



n" +1 <T 



(n oo). 



we have for the peak at t = 1 , 



tf»(0) = 



„n+ 1 



2n 



n" +1 e~ n 



n 1 
2 n n ! 



w n 



t 



n 1 
In n ! 



n 

In 



as n -> oo . This shows that as n increases, the graphs grow higher, but their widths become 
narrower due to the constant unit area under the curves. Fig. 1.11 shows the graphs of 8 n (t - 1) 
for increasing values of n . 
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Second, 



lim A n (s) = lim 

n-*oo n-> oo 



1 



(1 + 




: A(j). 



This leads to the following conclusion: The sequence 8 n (t - 1) converges to something that is 
"infinitely high", "infinitely narrow" and still has "unit area under the curve". Moreover, this 
entity has A(s) = e~ s as its image function. This object, which cannot be considered as an 
ordinary function, as we will see below, is called the Dirac Impulse located at t = 1 and is 
denoted by 6{t- 1). It must be considered as some sort of a generalized function with the 
correspondence 






It is seen that 5 n (t - 1) is n- 1 times continuously differentiable on the real axis and that 
<j) n (f) := 8 n (t - 1) satisfies 0 n (m) ( 0+)= 0, provided that m < n. Thus, by the differentiation 
rule we have, for sufficiently large n, 

5 n (m) {t- l)-»-B *- A „(s). 

Fig. 1.12 shows the first derivatives of 6 n (t - 1) for increasing n . 



As n oo one has the limit relation 



& m \t y«-*. 




By the original shift rule with the shift a - 1 , we obtain 
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n n+l 

6„(t — a+ 1-1) = — -u(t-a+l)(t-a+l) n e- n(, - a+1) 
n ! 

■ e ~( a ~V s A n ($), 



or 6 n (t-a)°°-* e (a l)s A n (s), 

which as n -> oo, and A„(,s) e~ s tends to 



S(t — a) do — ■ e ~ as . (1.68) 

Similarly, we find 

e ~ as (1.69) 

For a = 0 we have 

1 (1.70) 

J (m) (0°D-» s " 1 . (1.71) 



Let us recapitulate: We have introduced a new generalized function 6(t - a), called the Dirac 
Impulse at t = a and its "derivatives" £ (m) (t - a). This Dirac Impulse has a "peak" at t - a, 
infinitely high and infinitely narrow but with unit area under the curve: 



6{t - a) - 0 , t =£ a 
6(t-a ) = oo , t - a 




6{t-a)dt = 1. 



(1.72) 



Furthermore, we found the correspondences 

6(t - a) □□ - ■ - a) - ■ sT e~ as 



(1.73) 



This gives an intuitive idea of what the Dirac Impulse and its derivatives are. Unfortunately, it 
cannot be put on a firm mathematical basis in this way. The three properties (1.72), for 
example, are contradictory. If 8(t-a) were an ordinary function satisfying the first two 
properties, its integral would be zero, for any definition of the integral. 

You can turn it around either way, it will not be possible to establish a mathematically and 
logically correct theory of the Dirac Impulse in the manner sketched above. The problem is 
more profound and needs a whole new theory that generalizes the notion of functions. There 
are several approaches for doing so. The best known currently is Laurent Schwartz’s Theory of 
Distribution [Schwartz (1965)], [Zemanian I (1987)], [Zemanian II (1987)]. Another inter- 
esting approach is the Theory of Sato’s Hyperfunctions [Imai (1992]. 

We introduced the Dirac Impulse and its derivatives as the limit of the sequence of functions 

n n+ ^ 

6 n (t- 1) := —-u(t)f e ~ nt 
n ! 

and of their derivatives. By repeating the same steps, with the above sequence replaced by a 
sequence of Gaussian densities with standard deviation equal to 1 /n and mean a , 
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n r n ?1 

8„(t-a) := exp|- — (t-a) j Exp 



2« 2 



- 



the same relations 

6(t-a)°°-» e~ as , 

are obtained, as n -> 00 . There are many other sequences of functions that can be used in order 
to produce the above relations. See for example [Van der Pol and Bremmer (1987)]. But the 
fundamental objections are not removed in any of these classical approaches. 

Remark. The approach of Section 1.2.3. 1 with the sequence of original functions 

n n +i 

6 n (t- 1) := — -w(f) f e~ nt , t> 0 
n ! 

can be used in the context of the one-sided Laplace transformation until the step where we 
invoke the original shift translation rule. But the shift has to be restricted to a - 1 > 0 . If we 
used a left shift with a < 1 , a part of the graph of 6 n (t - a) would be cut away and the area 
under the curve would become smaller than unity, since the left shifted original is in fact 
u(t) 6 n (t - a). Also (p(0 +) = S n (-a) becomes different from zero with the effect that the 
differentiation rule is no more a simple multiplication by s. Besides the difficulty with the 
derivative, we would, in the case of a = 0, wind up with the limit relation 5{t) ° ■ 1 / 2 . But 

this is not what is wanted. Some authors try to bypass these difficulties by defining the one- 
sided Laplace integral by 

a»oo 

F(s) = J o e~ st f{t)dt 

in order to get hold of the entire Dirac Impulse at t = 0 rather than just half of it. But this ad 
hoc repair is not satisfactory and leaves other difficulties untouched. In order to avoid such 
difficulties the Dirac Impulse should be introduced in the context of the two-sided Laplace 
integral. 



1.2.3.2 Further Relations involving the Dirac Impulse 

By use of 



n n+ 1 / yi \«+l 

:= — U {t)fe- nt ™-m 

n ! V 5 + n / 

and the original shift rule we obtain 

Sn(f -a)= 8 n (t - (a - 1) - 1) (— )" +1 , 

8 n (t-b)= 8„{t-{b-\)-\) e - (b ~ l)s (—) n+1 . 

\s + n> 

The Convolution Theorem implies 



6 n (t-a)*6 n (t-b) □□ 



e -(a-l)s e -{b-\)s 




n \ w+1 
s + n / 
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and the expression on the right-hand side can be written as 

\n+l / n \w+l 



1 



_ e ~(a+b~2)s 



_ e -(a+b-2)s j 



-(a+ b-2) s 



l)s e -(b-l ) sl^\ n 

/ n \2 n+2 

\s + n' 

(^fOarWlt 

= e“ (a+i, t (n ^ oo). 

The last expression is the image of 6(t ~ a- b). Hence 
6(t - a) * 6(t -b) - Sit - a- b). 

Next, let fit) dd - ■ F(s) and 

o / n \ n+1 

&n(t) = e s (— — ) 

V s + n f 

By the convolution theorem we have 

£.(0*/(0 oa -" e s (— ) F(s) = e s (— ^— ) ■■ „ F(s) . 

\s + nJ \s + n> (1+s/ri) 

As n -> oo we obtain the limit 



(1.74) 



thus 



e s 1 — F{s) = F(s) 
e s 



m*m = /«. 



(1.75) 



This shows that the Dirac Impulse acts as a unit element with respect to the convolution 
product. The above relation is often written as 



r 



5{t - x) fix) dx = f(t). 

o 

Also, by the similarity rule with a = - 1 , we have 

„ / n \ n+1 „ / n \ 1 

s.(-,) (— ) = <T (ztttt) 

Therefore the Dirac Impulse is an even generalized function: 

6(-t) = Sit). 

Thus, the previous integral can also be written as 
f°° Six - 1) fix) dx = fit). 

OO 



(1-76) 




Laplace Transformation 



61 



Again let fit) ■ F(s) and 



/ n \ w+1 

dnit) = □□-■ e s ( . 

V s + n ' 

By the differentiation rule 

\s + n' 

and by the Convolution Theorem we obtain 

S k e s {-^—) n+> F(s) = e s (— ) 1 {s k F{s)} 

The limit n -> oo yields 

tf k) {t)*f{t) ■ e' — (/ F(s)} = s k F(s) /*>«, 
e s 

therefore 

0*0 */« = /*(»)• 

Next, we consider the following sequence and use the multiplication rule. 

d ( / n \ w+1> i c / n \ n+1 5 — 1 

t6 n {t) - —{e s {——\ } = 

ds y \s + n / 1 V 5- -h /i / 5 + n 

1 

(l+5/n) w 



= _«' (_L_) l izi. 

W + n/ (l+5/n) w 5 + n 



The last expression tends to 

— > -e* 1 — 0 = 0, n -> oo. 

W + n ' (1+5/n) 5 + n 

This yields the relation 

f<5(r) = 0. 



1.3 Ordinary Linear Differential Equations 



■ 1.3.1 Differential Equations with Constant Coefficients 

1.3.1.1 Scalar Differential Equations of Order n 

Let us introduce the linear differential operator of order n 



(1.77) 



(1.78) 
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L a " df + a " _1 df~ l + "' + ai dt + a °’ (a " * 0) ' 

The operator L acts on an original function y(t) as follows: 

d n y d W_1 y dy 

Ly(t) := -^r + a,-i — r + -+*— + ootff). 

A linear scalar differential equation of order n and with constant coefficients can be written in 
the form 



Lyit) = f(t). (1.79) 

The given function fit), is called the excitation , solicitation , non-homo geneous term or the 
input function. The solution y(t) is called the response , answer or output function. As in 
system theory, we think of (1.79) as a mathematical model of a physical system represented by 
the block diagram (Fig. 1.13): 



m k 


tv Mtpm 


y(t) b 




»3 ViJI-Cf FI 





Fig. 1.13: Block diagram of an input-output system. 



A system is called linear if a linear combination of input functions produces an output that is 
the linear combination of the individual input functions (Fig. 1.14): 



ci.f,mc 2 M^ 



linear system 



qyi(t)+C7y?Xt) 



Fig. 1.14: A linear system. 






A system is called time-invariant or fixed if a delayed input f(t - a) produces a corresponding 
delayed output y(t - a) for any constant a . 






¥ 



fixed system 



Fig. 1 . 1 5 : A fixed linear system. 






¥ 



Time-invariance means that the choice of the initial instant to for a measurement or observation 
is irrelevant for the behavior of the system. No matter whether the system is observed today or 
tomorrow, identical inputs will always produce identical outputs. Thus for time-invariant 
systems, one in general chooses the initial instant to = 0. If a system is modeled by a linear 
differential equation with constant coefficients, then it is a linear time-invariant system. The 
system modeled by (1.79) is a special case in terms of the input function. In applications, often 
the right-hand side f(t) is replaced by 



(bo + bi % + - + b m ^). 
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i.e. a linear differential operator R of order m acts on the input function. In this case the 
differential equation is 

Ly(t) = Rf(t). (1.80) 



The solution of a scalar differential equation of order n is not unique. The general solution 
consists of a family of functions depending on n arbitrary parameters (integration constants). 
In order to obtain a unique solution, in the sense that a given input function f(t) produces a 
uniquely determined output y(t), we have to impose additional conditions on the solution. If 
the conditions are all related to the same initial time t 0 = 0, we call it an initial value problem. 
Thus an initial value problem consists of 



Ly(t) = Rf(t) , 
y(0 +) = y 0 , 
y (0 +) = yo' , 

y " (0 +) = yo" y"- 1 >(0+) = V" _1) . 

where the n initial values yo , ... , v’o ( " !) are to be specified. 



(1.81) 



If the solution is restricted to a finite interval, for example to [0, /] , and if the additional 
conditions are related to the two endpoints of the interval, we deal with a boundary value 
problem . A boundary value problem, for example, is: 



d 2 y 

y(0) = a , y(f) = b. 



The most effective method to handle problems with linear ordinary differential equations with 
constant coefficients is by means of Laplace transformation. 



The left linear differential operator of order n 



d n cT 1 - 1 d 

L:= df +an - l ~^ + ''' +ai d; +ao ’ (an = 1) 

is associated with the characteristic polynomial of degree n 



(1.82) 



P(s) := s n + a n - 1 s n 1 + ••• + a\ s + a$ . 



(1.83) 



The leading coefficient of the left differential operator L is assumed to be 1. Similarly, the 
right differential operator 

d dT 

R:= z , 0 + fcl _ + ... + fcm _ 

is associated with the polynomial 



0(s) := bo + b\ s + ••• + b m s m . (1.84) 

Now we assume that y(t) and its derivatives as well as fit) have (one-sided) Laplace 
transforms: y(t)°-u Y(s), f(t)°-m F(s). By the differentiation rule and the linearity, the 
image of the solution of the initial value problem (1.81) can be arranged as follows: 
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v , s G(s) r , s . s" 1 + 2 + •••+ ai 

m = ^ to ♦ » m 



+ yo 



, s" 2 + a n - 1 s" 3 + ■■■ + a 2 

m 



+ •••+ V' 1 - 2) ^^ L + V"- 1) 



- /( 0 .+) 



P(s) 

bi + -+ b^r- 1 
P(s) 



P(s) 



-/'( 0 +) 



bl H H ftm-1 J 1 ” 2 

m 



/0-2>(O +) fcm - 1+fcw ^ - /0-»(O +) — . 

P(s) 7 P(s) 

In the case of (1.79), where no differential operator is acting on the input function, the 
expression above reduces to 



1 s n 1 + a n - 1 s n 2 + ••• + a\ 

rW = PW + » FU) 1 



+ yo 



, s" 1 + a n - 1 S" 3 H +02 

m 



( 1 . 86 ) 



+ yo 



(»- 2 ) 



•? + a«- 



+ >0 



(«-l) 



P(5) 



The original function y{t) corresponding to (1.85) or (1.86) respectively is called the global 
response or global answer of the system. If all initial values of the response are zero, i.e. 



y(0 +) = / (0+) = ••• = y (B_1) (0+) = 0, 



(1.87) 



then the response of the system consists of only 
3,1(0 = 



- r l 



/( 0 +)- 



fm-l ■ 



P(s) 



+ /'( 0+) 



b 2 + ■■■ + b m - 1 s m 2 



P(s) 



+ - + / m ~ 2) (o +) + Z“ -1) (o+) 









If no differential operator acts on the input, the latter simplifies to 




The function y\(t) is called the forced response of the system. If (1.87) holds, we say that the 
system is in a non-excited or in a quiet initial state. If there is no input function, i.e. fit) = 0, 
but the system is in an excited initial state (some or all of the initial values are non-zero), then 
the response of the system consists of 
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yo(0 = yo -C 1 



S " 1 + 1 i" 2 H h «1 



(0 



+ yo' -C 1 



y 2 + a„_i y 3 h — + a2 

W) 






«■<) 



which is called the/r^ response of the system . The global response of the system is the sum of 
the free response and the forced response. A system which is in a quiet initial state has no free 
response and its global response is identical with its forced response. 



The general expression for the global response (1.85) clarifies that the system behaves like a 
linear system only if it is in a quiet, i.e. non-excited initial state. For non-zero and arbitrary 
initial values, the linearity condition, which requires that if the input f\ (t) produces the output 
yi(t), and the input / 2 W produces the output yiit), then the input c\ f\(t) + q / 2 W produces 
the output ci yi (t) + C 2 yi (0 , can be violated. 



1.3.1.2 Stable Systems and Transfer Functions 

A linear system is called asymptotically stable if for arbitrary initial values the free response 
(the response corresponding to f(t) = 0) tends to zero as t -> 00 . This means that after a certain 
lapse of time the global response is essentially equal to the forced response because the 
influence of the initial values fades away. In other words, after a certain lapse of time, the 
output of the system is essentially determined by its input and not by the generally 
uncontrollable initial values. A real physical system should be an asymptotically stable system, 
otherwise it is of no reliable use. 



From (1.85) it can be seen that a system modeled by (1.81) is asymptotically stable if and only 
if the sum of the rational image functions 



yo 



s n 1 + a n - 1 s 11 2 + 



+ a\ 



„n- 2 



+ • • • + yo 



m 

in-2) S + a n- 



+ yo 



+ a n - 1 S n 

m 



P(S) 



+ yo 



(n-l) 



P(s) 9 



+ a2 



which have the characteristic polynomial P(s) as their denominator, give rise to originals that 
tend to zero as t -> 00 . These rational image functions all are proper rational functions. By 
applying the partial fraction decomposition, we obtain a sum of terms of the type 



z 



Ck 

(s - ar*/‘ 



where the a* ’s are the zeros of the characteristic polynomial P(s), i.e. the poles of the rational 
function Q(s)/P(s). In Section 1.1. 4.1 we observed that a partial fraction term 
1 /(s - ak) tk has an original that tends to zero as t -> 00 if and only if the pole or* is in the left 
complex half-plane, i.e. if 0 * has a strictly negative real part. Thus the following proposition 
holds. 



Proposition. The system modeled by (1.81) is asymptotically stable if and only if all poles of 
the rational function 
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G(s) := 



Q(s) 

P(s) 



( 1 . 88 ) 



have strictly negative real parts , i.e. are located in the left complex half-plane. 

G(s) is called the transfer function of the system. It is obtained by merely inspecting the two 
differential operators. 



If an asymptotically stable system is exposed to a non-zero input, the terms containing the 
initial values of f(t) and its derivatives 



- /( 0 +) 



b\ + ••• + b m - 1 s m 
P{s) 



-/'( 0 +) 



bi + • • • + b n 
P{s) 



s m ~ 



/ 0 - 2> ( 0 +) hazLlpll _ /- 1)(0 +) b ‘ 



P(s) 



P(s) 



are improper rational functions if the order m of the right-hand side differential operator is 
greater than the order n of the left-hand side differential operator. Improper rational functions 
can be decomposed into a sum of a polynomial and a proper rational function, which in the 
above case, has again P(s) as its denominator. The inverse Laplace transform of a polynomial 
in s is an expression of Dirac Impulses and their derivatives at t = 0. Since asymptotic 
stability describes the behavior of the system for large values of time t , the Dirac Impulses at 
t = 0 do not affect the behavior of the system for large t. 



In an asymptotically stable system the output components which are produced by the non-zero 
initial values of the response and of the input will eventually fade away such that after a certain 
lapse of time only the part due to 

G(s)F(s)= ^-F(s) 

P(s) 

prevails. First, this means that for sufficiently large times, the system behaves like a truly linear 
system. Secondly, that the system can be characterized, after an initial transitory phase, by its 
transfer function G(s ) . This explains why an asymptotically stable system is represented by the 
block diagram (Fig. 1.16): 



F(s) 



¥ 



Gis ) 



Y(s) = G(s) F(s) 



* 



Fig. 1.1 6: Representation of an asymptotically stable system. 



The poles of the transfer function are the zeros of the characteristic polynomial P(s). A 
polynomial is called a stable polynomial (or a Hurwitz polynomial), if all its roots have strictly 
negative real parts. Therefore, testing the stability of a system amounts to testing whether or 
not its characteristic polynomial is stable. The roots or zeros of a polynomial of degree higher 
than 2 are not readily available. We need a test to try out whether all roots are located in the 
left half-plane, by merely inspecting the coefficients of the polynomial. The best known 
stability test is the Hurwitz Test. We give it without proof. For a proof and other stability tests, 
see for example [Sarachik (1996)]. The Hurwitz Test uses the so-called nxn Hurwitz matrix 
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'0n-i 


0/1-3 


0/i-5 


0/i-7 


.. 0\ 




0n 


0 /i -2 


0/i-4 


0 / 1-6 


.. 0 


H = 


0 


0 / 1-1 


0/i-3 


0/i-5 • • 


. 0 




0 


0 /i 


0 /i -2 


0/i-4 •• 


. 0 






where the first and second rows of H are completed by filling in zeros on the right to obtain 
n columns, i.e. a v =0, if v<0. A new row i (i > 2) is formed by shifting row i-2 one 
position to the right, dropping the rightmost element and filling a zero in the first column. This 
process is carried out for i = 3, 4, . . . , n . 

The Hurwitz Test. The polynomial 



P(s) = a n s' 1 + a n - 1 s n 1 + ••• + a\ s + 00 (a n ± 0) 
is stable if and only if all principal minors are positive. 

The positive principal minors are: 



Ai 


:= a n - 


1>0, 


, A 2 := 


:detr 


n- 1 0/1-3 \ 


> 0, 




' 0/i 0/i-2 ' 








r a n - 1 


0/i-3 


0/1-5 ' 






A 3 : 


:= det 


a„ 


0/i-2 


0/i-4 


> 0 ... A„ 


:= det H > 0. 






0 


0/1-1 


0/1-3 y 







The n conditions of the Hurwitz Test are redundant. Lienard-Chipart proved that it suffices to 
verify the conditions for A, for all odd / ’ s or for all even /’ s, provided that all >0. 



Example. P(s) = 04 s 4 + 03 s 3 + 02 s 2 + a\ s + ao ; 



'03 


01 


0 


0 1 


04 


02 


00 


0 


0 


03 


01 


0 


. 0 


04 


02 


00 > 



Provided that all five coefficients are positive, the polynomial is stable if and only if 



A 3 



/ 



det 



v 



fl3 fli O' 
04 0 2 00 

0 03 0i , 



>0. 



The condition that all coefficients of the polynomial must have the same sign (all positive or 
all negative, but none zero) is a necessary condition for the stability of the polynomial. The 
condition is not sufficient, except for the case n = 2 . A polynomial of second degree is stable, 
if and only if all three coefficients are all negative or all positive. If one coefficient of a 
polynomial of degree n is zero, i.e. if some powers of s are absent, the polynomial is 
necessarily unstable. 



Example. Consider 

y" + 26 y' + w 2 y(t) = /(f), 

?(0+) = A, 

/(0+) = B, 
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P(s) = s 2 + 26 s + a? = (s + S) 2 + fl 2 , XI := V (o 1 - S 2 , 

GW = 1. 

The system is asymptotically stable if 6 > 0, unstable if 6 < 0. We assume 6 > 0 and 
oj 2 - S 2 > 0. The Laplace transform of the solution is: 

1 s + 26 1 

(.? + <5) 2 + n 2 (s + s? + n 2 (s + 5) 2 + n 2 

The free response is given by 

. I" (.y+(5) B + AS XI 1 
yo(t) = £- l \A - + — ; — — — « 



Cs+<S) 2 + fi 2 ft (s+sf + n 2 



_s t ( B + AS \ 

= u{t) e jAcosXU + — — — sin City 

For the unit-step response (the forced response of the unit-step function as an input) we have: 
F(s) = 1/s, 

+ ff]] <o 

= u(t) {l - e~ 6 { ^cos Fit + ^-sinfujj. 

The unit-ramp response (forced response of u(t) t as an input) is: 

F(s) = 1/s 2 , 



n(t) L ls 2 [(s + S) 2 + n 2 ]. W 



= ««{■ 



26 1 

' 7 T + 77 “ 1 



) + «(f) 



fl 2 -<5 2 

26cos£lt — sinXlf 

XI 



Due to the notation of originals, the factor u(t) can also be omitted. For the computation of the 
last two inverse Laplace transforms a table [Oberhettinger F. and Badii L. (1970)] was used. 

Example. Consider the following initial value problem: 

y 0) + 3y" + 3 / + y(t) = e l , 

y( 0 +) = 0 , 

/( 0 +) = 0 , 

/( 0 +) = 0 , 

P(s) = s 3 + 3s 2 + 3s + 1 = (s+ l) 3 , Q(s) = 1, F(s) = l/(s+ 1). 

The system is asymptotically stable. The solution is 






Example. Consider the system modeled by 
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y (3> + 3/ + 3/ + y(t) = fit) + If (t), 
y(0+) = 1, 
y'(0+) = -l, 
y"(0+)= 2, 

P(s) = s 3 +3s 2 +3s+l = (s+ l) 3 , Q(s) = 1 + 2s. 



The transfer function of this asymptotically 



OlUl/XV k 



G(s) = 



1 + 2s 



(s+ If 

The free response is given by 

s 2 + 3 s + 3 



Y 0 (s) = 



5+3 



( 5 + 1) 3 ( 5 + 1) 3 

s 2 + 2s + 2 (5 + l)^ + 1 



+ 2 - 



(s+lf 



(s+lf 

1 



(^+d 3 



1 



— J - 0 y 0 (0 = e ‘ + — e 



is +1) (s + l) 3 

The forced response to the input fit) = t 2 is, observing that /( 0 +) = 0, 



1 + 25 2 45 + 2 

Ft CO = - — -5- -5- “ 

(.J+l ) 3 s 3 

_ an an a\3 

5 3 + 5 2 + 5 

'45 + 2 



s 3 (s + l) 3 

an 

is + l) 3 + Cs + l) 2 



am 



ai3 

5+1 ’ 



a\\ 



an 



an 



= (!i±l) = 2 , 0l2= (i_(ii±l)) = _ 2 , 

V is + 1) J s=0 \^s V is + 1) )) s= 0 

( 1 <P ( 4s + 2 Y| „ (As + 2x 

/J/45 + 2\\ H rf 2 /45 + 2\) 

= f = 2 ’ 023 = It ^ t p - )J„_, = “■ 



Therefore y i (0 = t 2 - 2 1 + t 2 e ' + 2 t e 



1.3.1.3 Special System Responses 

Suppose that the input-output system is asymptotically stable and that it is described by its 
transfer function G(s ) . Thus all poles of the transfer function are located in the complex left 
half-plane, i.e. they all have strictly negative real parts. Furthermore, suppose that the system 
is real, implying G(s) = G(s). 

The unit-impulse response g(t) is the response of the system to an applied Dirac Impulse S(t), 
where all initial values (of the input and the output) are assumed to be zero. 

Because f(t) = 6(t) ° - ■ F(s) = 1 and (1.85) we see at once that the Laplace transform of the 
unit-impulse response is 
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Y(s) = G(s)F(s) = G(s) 1 = G(s), 

i.e. the unit-impulse response is equal to the inverse Laplace transform of the transfer function 
of the system: 

g® = r'iGwm. (i.89) 

The unit-step response is defined as 

y st (0 = £- 1 [-^-](0. d-90) 



From (1.85) we see that up to a transient the unit-step response is equal to the response of the 
system if the input is the unit-step function. A transient is a function of time that tends to zero 
as t -> oo . The terms corresponding to the initial values of both the input and the output in 
(1.85) yield transients when transformed back. In the case where there is no differential 
operator acting on the input function, the unit-step response is the response to a unit-step, 
where all initial values of the response are assumed to be zero, meaning that the system is in a 
non-excited initial state. Let us now compute the unit-step response. Because the system is 
assumed to be asymptotically stable, the transfer function G(s) is holomorphic on a right half- 
plane that contains the imaginary axis in its interior (the right most singularity still has a 
strictly negative real part). The Laplace transform of the unit-step response is given by G(s)/s . 
The integration rule gives 



L = u(t) J' g(t)dt = u(t) |J~” g(t)dt - g(t)dt 

= (u(t)J™ e~ s ‘g(t)dtj - u(t)f g(t) dt 
= u(t) G(0) - u(t) g(t)dt . 

The last term on the right is a transient which tends to zero as t -> oo . We have proved: 



Proposition. The unit-step response of an asymptotically stable system described by its 
transfer function G(s) is, up to a transient, given by G(0) u(t). We also say that the steady- 
state part of the unit- step response is given by G(0) u(t). 



The frequency response of the system is defined as 



i— 1(0. 

L S — lb) J 



(1.91) 



As above the frequency response is, up to a transient, the response of the system to an applied 
sinusoidal input of the form exp(z ot). If there is no differential operator acting on the input 
function the frequency response is the response to exp (i a> t ) , provided that the system is in a 
non-excited initial state (all initial values of the response are zero). 

We obtain the frequency response by using the Convolution Theorem 
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x ~1t^ 7Z7 G(s) ] (0 = X el01{ ‘~ x) g{x)dx 

= e iat f e-‘ wx g(x)dx 

Jo 

= e lu ' e~ iwx g(x)dx- J°° e~ l 



g(x)dx 



= e lu>t G{ico) 



c g(x)dx. 



Because the imaginary axis is inside the half-plane of convergence of G(s ) , the last term on the 
right-hand side is a transient which tends to zero as t -> oo . We proved: 

Proposition. The frequency response to f(t) = exp (i co t) of an asymptotically stable system , 
described by its transfer function G(s), is, up to a transient, given by y(t) = G(i co) exp ( i a>t). If 
the complex-valued function G{i co) of the real variable co is written in polar coordinates : 

G(ico) = a(co)e l<p ^\ a(co) = \G(ico)\, (p(co) = ar gG(ico), 

then, up to a transient, the frequency response is 



y(t) = 



( 1 . 92 ) 



By superposition, and assuming that the system is real, we also conclude that up to a transient 
the frequency response to sin co t and cos co t is 

y(t) = a(co) sin[<j t + <p(co)] , y(t) = a(co) cos[a> t + (p(co )] , 



respectively. This means that up to transients an asymptotically stable linear system responds 
to a sinusoidal input of angular frequency co and amplitude a by multiplying the amplitude a 
by the amplification factor a(co) = | G(i co) \ and by producing a phase shift of 
ip(co) = arg G(i co) in the response. Both amplification factor and phase shift are functions of 
the frequency. The response has the same frequency as the input. The frequency response and 
the unit-step response are related to each other. One can be computed from the other. If the 
unit-step response y st (t) is given, the frequency response Uf{t) is obtained as follows: 



YM = 



G(s) 



y s t(0 



-/ 



G(s)= £[y st ’(t)](s) 



g(j)dr => y st '(r) = g(r) 

G(iw) = £bst'(t)](iw). 



Hence we obtain the frequency response from the unit-step response as 



y f (t) = A 



d y st 

dt 



(ico) e i0Jt . 



More interesting is determining the unit-step response from the frequency response. Let us 
introduce two notions from electrical engineering. 



The real part of G(ico) is called the conductance of the system and is denoted by U(co). The 
imaginary part of G(i co) is called the susceptance of the system and is denoted by Vico ) , thus 
G(ico) = U(co) + iV(co). 
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Conductance and susceptance are measurable quantities. It was shown, see for example 
[Doetsch (1976)], that the unit-step response can be computed from the conductance or from 
the susceptance alone. The result is 



y s t(0 = u{t) 
= u(t) 



2_ r°°i 

* Jo 

i r 

* Jo 



sin cotdco 



V(cj) 

sin cotdco + £/(0). 



(1.93) 



The advantage of these formulas is that conductance or susceptance can often be measured 
more easily than the step-response itself. 

Example. Suppose that a system is modeled by the differential equation 

y" + 2/ +5y« = 3/(0 -/'W. 

This is an asymptotically stable system since the characteristic polynomial is of degree 2 with 
all three coefficients positive. 



P(s) = s 2 + 2 s + 5, Q(s) = 3-5, G(s) = 



— 5 + 3 



5 2 + 2s + 5 ■ 



The steady-state part of the unit-step response is «(/)G(0) = (3/5) u{t ) . The total unit-step 
response is 

£ ~ l l s(s2~Hs\5) V t) = “W{| + 2 e -'(-^cos(20-|s,n(2r))}. 

The forced response to a unit-step in the general case where a differential operator acts on the 
input function is not the same as the unit-step response defined above! For this example, the 
forced response to the unit-step is 

■ r ‘ L^+L.5) ] (,) = w sin(2 '>)}- 

In order to compute the frequency response to cos cot, for example, we first write 



G{ioS) 



-ico + 3 



15-5 co 2 



- w 2 + 2 i(o + 5 4 w 2 + (5 - o> 2 ) 2 

Therefore the conductance and the susceptance are 



+ i ■ 



co (co 2 - 11) 
4<j 2 + (5 - co 2 j 



2 * 



U(a>) = 



15-5 co 2 



4oj 2 +(5-oj 2 ) 



2 ’ 



V(co) = 



co (co 2 - 11) 
4o> 2 + (5 - co 2 ) 2 



The amplification factor and the phase shift are 

I -ico + 3 I 



I G(ico) | = 



= arg 



| - co 2 + 2 i co + 5 | 
15-5 co 2 



co 2 + 9 



4co 2 +(5 - co 2 ) 



+ i ■ 



4 a* 2 + (5 - w 2 )' 

w(w 2 - 11 ) 



2 ’ 



4co 2 +(5-co 2 f 



= arg[15 - 5 co 2 + ico ( co 2 - 1 1)] 
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giving finally the frequency response 



yit) = 






co 2 + 9 

W + (5- w 2 ) 2 



coster + ^>(<u)]. 



Problem 1.30. Show that, in the general case of (1.81), where the differential equation also has 
a right-hand differential operator acting on the input function, the forced response to the unit- 
step function is given by 



which is not the same as the unit-step response defined as 



iT 1 [-^rrl(0 (Q(s)= b 0 +b lS +-+b m n. 

L s P(s) J 

Problem 1.31. Verify the formulas (1. 93) for G(s) = 1 /($ + 1). 



1.3.1.4 Systems of Ordinary Differential Equations 

The mathematical modeling of a physical system often results in a system of differential 
equations rather than in a single scalar differential equation. The method of Laplace 
transformation is well adapted for solving linear systems of differential equations with constant 
coefficients. It is not necessary that the system be a system of first order differential equations, 
but the reader should be aware of the occurrence of particular effects concerning initial value 
problems in connection with a subclass of systems of higher order differential equations, called 
anomalous systems. Anomalous systems are widespread in applications and we shall treat 
them in a later chapter. The basic method for solving systems of differential equations is 
straightforward and is best explained by way of an example. 

Example. Solve the following initial value problem: 

- yit) = t , 

/ + jc (t) = 0 , 

jc(0 +) = 1, jc' (0 +) = 0, y(0 +) = -1 . 

Let us assume that the two variables x(t), yit) and their derivatives are Laplace transformable. 
By use of the differentiation rule, the linearity and the specified initial values, the image 
system becomes 

s 2 X(s) - s - 0 - y(s) = 4- , 

S l 

sYis) -(-1) + Xis) = 0. 

This is a linear system for the two unknown image functions Xis) and F(s). In matrix notation, 
the system is written as 

c; vio-rtn 

By Cramer’s rule, 
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3 -5+ 1 






s(s 3 + 1) 



s 3 - s + 1 

5 ( 5 + 1 )(s 2 - 5+1) 



? 4 + 5 3 + 1 



2 (5 3 + 1) 



5 4 + 5 3 + 1 

5 2 (5+ l)(5 2 -5+l)‘ 



By applying the inverse Laplace transform to these image functions we obtain the solution. 
This is done for X(5) : 



X(s) = 



5 3 - 5 + 1 

5(5+ l)(5 2 -5+l) 

5 3 - 5 + 1 



s(s+ l)[s-(l/2 +V3/2j)] [ 5 -(1/2 -V3'/2i)] 

C3 C3 



C1 + ^- + 



s s+l j-(l/2 + VJ/2 j) s-(l/2 -V3/2i) ' 

The coefficients of the partial fractions are determined as follows: 

( 5 3 — 5 + 1 ^ ( 5 3 — 5 + 1 ^ 

Cl US+ l)(s 2 -s+l)J J = 0 ’ ° 2 L(s 2 -S+ 1) J j= _! ^ 3 ’ 

1 + V3 i 



C 3 = 



s 5 - s + 1 



^ + l)[,-(l/2-V3/2 I )]L 1/2+VT/2j 



Hence, 



x(t) = 1 - je~‘ + e' 12 



1 ( V3 \ V3 . ( V3 ) 

3 l 2 J 3 ( 2 j 



Similarly, 



1 2 , /9 , 
y(t) = - t - —e - — e t/2 cos 



V3 



t\. 



A special, but important class of systems of ordinary differential equations are the systems of 
first order equations. A system of n linear first order differential equations with constant 
coefficients is best written in matrix notation. 



Y (0 - Ay(0 = f(0 

with the constant n x n -matrix A and the two n -vectors y = y(t), f = f(r): 



(1.94) 





'an ■ 


.. ai„' 




7i(0' 




7iW' 


A = 






, y (?) = 




. m = 








• • ^nn > 








Jnif ), 



We also need n initial conditions 



y(0+) = 



7i(0+)' 




f yio' 


^n(0+). 




<yn0> 



= • y 0 - 
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Introducing the following matrix-Laplace transforms 





'yi (ty 




ri'iW' 




(hit) 




'Fj(s)' 


y (t) = 




□ - ■ Y(s) = 




. m = 




F (s) = 






,y n(t ), 




X(s). 








J n (s), 



we obtain, by the differentiation rule applied to each component, 





'yi'( 0 ' 




'sFi(s)- yio' 


f it) = 










,y«'( 0 / 




k s Y„(s) - y n0 , 



sY(s)~ y 0 , 



the image system 

sY(s)- y 0 - AY(j) = F(j). 

With the n x n -identity matrix I the system can be written as 
(si- A)Y(s) = F(5) + y 0 . 

Using the resolvent of A, 

R(s, A):= (si- A) -1 (1.95) 

we can write the image vector of the solution as 

Y(s) = (s I - A)“ 1 F (s) + (s I - A) " 1 y 0 = R (j, A) F (s) + R(s , A) y 0 . 

The resolvent of A is an nxn -matrix with elements that are rational functions of s. The 
resolvent exists for all values of s where the determinant 

P(s) := det (si - A) =£ 0. 

This determinant P(s) of the matrix s I - A is a polynomial in s of degree n. P(s) is also the 
common denominator polynomial of all entries of the matrix R(s, A) . This fact together with 
the expression for Y (s) show that the system is asymptotically stable, if and only if all zeros of 
P(s) have strictly negative real parts (they are situated in the left complex half-plane), or which 
is the same, if and only if all poles of the resolvent are in the left half-plane. In this case all 
components of R (s, A) y 0 will be transients and the response of the system, after a certain lapse 
of time, is essentially determined by the forced response 

y(0 = £r l ms,A)F{sMt), 

and thus independent of the initial values. We see that for a first order system the determinant 
of the matrix si- A plays the same part concerning the stability behavior as does the 
characteristic polynomial of a scalar differential equation of order n . 

Problem 1.32. Establish the matrix correspondence 

R(s, A) := (si - A)" 1 ■ - ° e ,A , (1.96) 

where the matrix exponential function Y(r) = e ,A is defined as the solution of the matrix 
differential equation 
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4~Y = AY(f), Y(0) = I . 
a t 

A is a constant square matrix, and Y (t) is a square matrix whose elements are functions of t . 




Chapter 2 
z-Transformation 



2.1 z-Transforms and Inverse z-Transforms 



The z-transformation emerged, at least under this curious name, in the middle of the 20th 
century [Jury (1977)]. The basic idea is old and is known by the name of "generating function 
method" among the mathematicians. Indeed, the z-transform of a sequence is the generating 
function of this sequence, where the independent variable z is replaced by its reciprocal 1/z. 
The z-transformation or z-transform today is applied to model sample-data control systems or 
other discrete-data systems. Its role for discrete time systems is similar to the method of 
Laplace transformation for continuous time systems. From a mathematical point of view, the 
method of z-transformation is an operational calculus for solving difference equations or 
systems of such equations, similar to the method of Laplace transformation in connection with 
differential equations. The name z-transformation or z-transform is nonsense but, 
unfortunately, is in common use today (it is as if the Laplace transformation would be called 
the s-transform or p-transform). A reasonable name for this method would perhaps be 
"Laurent transform or Laurent transformation" because the defining series is a Laurent series. 
But it is too late for that. The z-transformation is intimately connected with the discrete 
Laplace transformation and with other discrete transformation methods. As is the case with the 
Laplace transformation, there is an ordinary or one-sided z-transform and a two-sided one. In 
this book we study only the one-sided z-transformation. However, the one-sided z- 
transformation has a generalization which is called the advanced or modified z-transformation. 
If the latter is applied to a sequence, there is no reason for a new name. It is just the ordinary z- 
transform applied to another sequence depending on a supplementary parameter. But if the 
domain of the originals is considered to be a set of continuous time functions rather than 
discrete time sequences, a new name is justified. The Laplace transformation maps a 
continuous function of the real variable t to a function of the complex variable s . Similarly, the 
z-transformation maps a discrete sequence to a function of the complex variable z. Both 
methods benefit from the theory of functions of a complex variable. 



■ 2.1.1 Discrete Transformations 

We first introduce the discrete Laplace transform. 

Definition. The discrete Laplace transform of the sequence f(k T) evaluated at kT with 
k = 0, 1, 2, ... and T > 0, is the function of a complex variable s , defined as 

oo 

F*(s) := Yjf^T)e~ kTs = : £ T [f(kT)] (*), (2.1) 

k=0 



provided that the series converges for some value of the variable s . 
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Observe that \e~ kTs \ = exp[-& TKs]. This implies that if the discrete Laplace transform 
converges absolutely for some real jco, it will converge absolutely for all complex s with 
Rs > Jt 0 . Thus, the domain of convergence of a discrete Laplace transform is a right half-plane. 
The discrete Laplace transform (with 7=1) is a discrete version of the ordinary Laplace 
transform 



£[/](*) 



-r 



f(t)e 



dt . 



Indeed, the discrete Laplace transform of the sequence f(k T) is the two-sided Laplace 
transform of the Dirac row 



oo 

/«£ 5(t-kT) 

k=0 

oo oo 

= Yjmdit-kT) = ^ /(* T) 8(t - kT) , 

k = 0 k=0 

i.e. £ T [f(k T )] (5) = £2 [f(t) zr=0 Sit -kT)] (s ) , because 



£ °° 

e- ,s nt)Y J S(t-kT)dt 

k=0 

00 ^00 00 

= ^ I e ~‘ s /w s{t-kT)dt = Yi e ~ kTs n 

—00 



Definition (2.1) has the advantage that it is "close to" the definition of the Laplace transform, 
but the disadvantage of being unnecessarily complicated. When computing some discrete 
Laplace image functions, the sub-expression e Ts will appear in the resulting image functions, 
and one is tempted to substitute z for e Ts . By doing so one obtains the z-transform. 



Definition. The z-transform of the sequence f(k T) k = 0, 1, 2, ... is the function of the 
complex variable z, defined as 



m--= J^fikDz-b, 

k = 0 



( 2 . 2 ) 



provided that the series converges for some value of z- 

The z-transform and the discrete Laplace transform of a sequence f(k T) are related by 

F*(s) = £ T [f(kT))(s) = F(e Ts ). (2.3) 

In the following, for simplicity, we assume T = 1 and consider the z-transform of the sequence 
f{k), * = 0,1, 2, . . ., i.e., 

oo 

F{z) := 

k = 0 

A convergent power series 
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i 00 

4 k = 0 

always has a disk \z\ < 1 /g as its domain of convergence. The mapping z i-> 1 /z maps the 
interior of the circle of radius 1 /g onto the exterior of the circle \z\ > Q- Thus the domain of 
convergence of a z-transform is always the exterior of a circle centered at the origin. Since a 
power series always converges uniformly and absolutely on its disk of convergence, the z- 
transform converges uniformly and absolutely on the outside of its circle of convergence. 
Furthermore, a z-transform is a holomorphic or an analytic function on the outside of its circle 
of convergence. 

The function 



4 k = 0 

is said to be the generating function of the sequence f(k). Thus the z-transform and the 
generating function of a given sequence are related by a change of the independent variable 
from z to 1 1 z and vice versa. The Cauchy-Hadamard formula gives the radius of convergence 
1 Ip of the power series G(z), see for example [Henrici (1974)], i.e. there is convergence if 



I Z I < 1/p = { lim sup a/ 1 f(k) I ) . 

Vfc-»oo ) 

Hence we conclude that the radius of convergence of the z-transform F(z) is given by 
p = lim sup | f{k) | 

k-> 00 



and the z-transform F(z) is an analytic function on the exterior of the circle \z\=Q. 
Clearly, if the sequence a/ | f(k ) | is convergent, we simply have 
P = lim </ | f(k) | . 

k-*oo 



Furthermore, if f{k) ± 0 for all sufficiently large k, the radius of convergence is also given by 
f(k+ 1) I 



p = lim 

k-*oo 



m 



provided the limit on the right-hand side exists (see for example [Henrici (1974)]). 



If for all sufficiently large k the sequence f(k) satisfies the relation 
I Kk) I Kr k , 

for some K > 0 and some r > 0, it is readily seen that the sequence will have a z-transform 
with a radius of convergence p < r. On the other hand, a sequence like f(k) = 2^ has no z- 
transform because the defining series does not converge for any finite z- We also have the fact 
that any function F(z), holomorphic outside some circle with radius p and centered at the 
origin, can be considered as the z-transform of a sequence f{k) . The sequence consists of the 
coefficients of the Laurent series of F(z) and is given by 
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m = 




(k = 0, 1 , 2 , ...) 



(2.4) 



where the path of integration C is a circle of radius r> p traversed in the positive (anti- 
clockwise) sense. This is a convenient formula for the inverse z-transform. Another formula 
for the inverse z-transform follows from Taylor’s theorem since a z-transform is a power series 
in s = 1 /z- Hence 



Notation. The correspondence between an original sequence f(k) and its z-image function 
F(z) is denoted by 

f(k)o-oF(z), 

F(z) = Z[f(k)](z ), F = Z[fl f(k) = Z~ l [F(z)] (*), / = Z' l [Fl 

In applications, the sequence f(k) is often generated by the sampling values of a continuous 
original function y(t) sampled at k T with a period or step T > 0, i.e., 

f(k):=y(kn (k = 0 , 1 , 2 ,...). 

The continuous time signal y(t) generates a discrete signal f(k) := y(kT) by a sampling 
process. The z-transform of the discrete signal y(k T) then is 

oo 

F(z) := J]y(kDz- k . 

k = 0 

Instead of sampling the given time function at instants k T, one can sample at instants kT + r 
where 0 < r < T . In this case the sequence is f(k) = y(k T + r) and the z-transform of the 
sequence becomes 



Y(z):= Yjy(kT + T)z- k . 

k=0 

Clearly, as long as r is regarded as a constant parameter there is no need to introduce a new 
name. Y(z) is just the ordinary z-transform of the sequence f(k) = y(k T + r) . But things 
change whenever r is considered as a second independent variable. In this case we write 

oo 

Y{z, t ):= Yjy( kT + T)z- k , (k = 0, 1,2, 0 <r<T) (2.5) 

k=0 



and Y(z, r) is called the advanced z-transform of the continuous time signal y(t) . Clearly, we 
have Y(z, 0) = F(z), the ordinary z-transform. 

Following the same line of thought allows us to generalize the discrete Laplace transform and 
define the generalized discrete Laplace transform of f(t) , evaluated at kT + t with step of 
length T > 0 and with 0 < r < T, by 
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f*(5,t):= £/(*r + T)<r* rs 

k=0 

= £ T mkT + TMs). 

Let us introduce yet another discrete transform of a sequence f(k ) : 






fc = 0 



( 2 . 6 ) 



(2.7) 



We call it the MacLaurin transform but this is not a recognized name. 

As for continuous originals in the framework of Laplace transforms (see Section 1.2.1), the 
domain of the given sequence f(k) may be extended by including the negative integers and 
defining f(k) = 0 for k <0. A typical original sequence, or a discrete signal, is then 
represented in Fig.2. 1 . 



y(k) 




The discrete unit-step is the sequence 



( 0 , 

u(k) := | j 



0, k = -l, 
k = 



- 2 , ... 

1 , 2 , ... • 



Its z-transform is 



z> 



k = 0 



z~ k = 



1 

1-1/z 



z 

~ T ’ 



Ul >1. 



Hence, we obtain the correspondence 

u(k) o-o — 

z- 1 

Thus, the z-transform of the discrete unit-step is a holomorphic function in the exterior of the 
unit-circle. The MacLaurin transform of the discrete unit-step is F(z) = e z . The z-transform of 
the sequence f(k) = a k is given by 
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z* 

* = 0 



,k £-k 



1 



l-a/z z-a 



a 1 

— < 1 <=> i z i > - — : 
z \a | 



and we obtain the correspondence 
z 



a k ©-< 



z-a 



which is a holomorphic function outside of the circle of radius \ / \ a\. The MacLaurin 
transform of / ( k ) = a k is F(z) = e az . An immediate consequence is 



o-O 



z-e a 



whence 



Jtak 



-icok 



o-o , o-O — 

Z-e l(x> z-e~ ia) 

and, by linearity (see below), 

sin wk= (e iwk - e- iwk ) , 

2l 

o-o — { — — ^-) 

2 i v z - e l(i) z - e~ lU) > 



zsmc^ 



z 2 - 2 z cos a) + 1 ’ 



Ul >1. 



Therefore 



sin a> k ° - o 



zsma) 

z 2 - 2 z cos a> + 1 



Similarly, 



cos a>k°-o 



z(z- cos <^>) 
z 2 -2zcosa> + 1 * 



We shall show below how the MacLaurin transform of the above sequences can be found by 
using the inverse Laplace transformation. 



The z-transform of the sequence f(k) = 1 /k\ is 

-o-oe l/z 
k\ ’ 

while its MacLaurin transform is 



~ ^ ( iVL\ 2k 

^ (z) = ^ k\nk+i) ^ = irmTiy = /o ( 2 ^ 

k ~° k = o 



where Iq is the modified Bessel function of order 0. 

We noted that a z-transform is a holomorphic or analytic function on the exterior of its circle 
of convergence. On the circle itself there must be at least one singularity. In most cases the 
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analytic function element formed by the z-transform and the exterior of the circle of 
convergence can be extended analytically into the interior of the circle of convergence. The 
singularities of the resulting global analytic function located on and perhaps inside the circle of 
convergence are isolated singularities (essential singularities or poles) or branch points. Let us 
look at the following three simple examples. 

Example. f(k):= l/k\ has the z-transform F(z) = exp(l /z) which is holomorphic for all 
| z | > 0. In this case the circle of convergence shrinks to the point z = 0 and the z-transform 
has an isolated essential singularity at the origin. 

Example. f(k) := 1 constant. The z-transform is F(z)=z/(z- 1) and the circle of 
convergence is | z I = 1 . The resulting global analytic function has the only singularity z = 1 
which is a pole located on the circle of convergence. 

Example. /( 0) = 0, f(k) = l /k, k>l. The z-transform is 

F(z) = In , | z I > 1. 

z- 1 

The circle of convergence is the unit-circle. If In denotes the principal branch of the logarithm 
(the one taking on real values for real z) then z = land z = 0 are two branch points and the 
global analytic function is defined on C\ [0, 1], i.e. on the finite complex plane with an 
incision from 0 to 1. 



2.1. 1.1 Laplace Transforms and Discrete Laplace Transforms 

In this section we shall establish a theorem that will be needed in Chapter 5 dealing with 
sampled-data control systems. First of all, we observe that the generalized discrete Laplace 
transform of the sequence y(k T + t) , 

CO 

r ( j, r) = Y j y(kT + r) e ~ kTs , 

k = 0 

is a periodic function of s with the imaginary period Ini/T: 

r(s + i Zf, r) = r (s, r). 

Proof. 

r(j + i r) = 2**r + r)e- kT ^ i2 ^ 

k=0 



oo . rs 

= Y j y(kT + r) e~ kTs exp (-* T 
k = 0 

oo 

= Yjy(kT + T)e- kTs = r(s,r). □ 

k = 0 

For a given original function y(t) with its Laplace image function Y(s) and the discrete Laplace 
transform Y*(s , r), we shall now examine in detail the mapping Y(s) Y*(s, t) and find a 
formula that expresses F'Cs, r) in terms of Y(s). 
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Theorem. Let the original function yit ) be continuous for t>0 with a finite y(0 +). If 

£ t 

yit) a - ■ T(j) and if y(k T + r)—> Y* ( 5 , r) ( discrete Laplace transform), then for t = 0 we 
have 



Y*(s , 0) = 



yi 0 +) 

2 



1 

+ pv — 



Z 




( 2 . 8 ) 



For t> 0 we have 



K*(.s, r) = pv Y £ y(s + i^n)exp[(s + i^n)r] . (2.9) 

n = — oo 

The two formulas show that if y(0+)=£ 0 the discrete Laplace transform Y*(s, r) has a 
discontinuity at r = 0 with respect to the parameter r. The symbol pv (principal value) means 
that 




n = -oo n = -m 



These formulas can be proved, for example, by making use of Poisson's summation formula. It 
says 

£ /(* T + r) = pv -i £ f(L- «) e‘ n(2n/T}T (2.10) 

k = -00 n — —00 

where 




f(x)dx 



is the Fourier transform of fix) . The formula holds if 

1 . £2, I /(*) \dx < 00 , 

2. f{x) is locally of bounded variation, and at points of discontinuity / is normalized 
such that 

ti , /(*-) + /(*+) 

. 



For a proof of Poisson’s summation formula, see any textbook on Fourier transforms, for 
example [Chandrasekharan (1989)] or [Gasquet and Witomski (1998)]. 



Proof of the theorem. We apply Poisson’s summation formula to the original 
fit) := uit)e~ st yit) where we have explicitly written the unit-step function w(f), and where 
the parameter s has a sufficiently large real part in order to satisfy the condition 1 above. The 
Fourier transform of fit) = uit) e~ st yit) becomes 




z-T ransformation 



85 



/(*>) = e~ ia)t u(t) e~ st y(t) dt 

— oo 

r r*oo 

e~ iu ‘ e ~s, y(t) df = f e -(* dt 

Jo 

= -C[yW] (s + icj) = y(^ + i c o ). 



Because we assumed that y(t) is continuous for t > 0, the normalization of fit) = u(t) e~ st y(t ) 
is y ( 0 +)/2 at r = 0 and equals itself everywhere else. We apply Poisson’s formula, first for 
r > 0. The left-hand side becomes 



Z f(kT + r) = Z u(k T + t) e - s(kT+r) y(k T + t) 

k - -oo k = -co 

oo oo 

= Z e~ sikT+T) y(kT + r) = e“ sr ^ e~ s kT y(kT + t). 



k = 0 

The right-hand side is 



£ = 0 



pv_ f X H~f- n ) ein(2nlT)T 

n = -oo 

= pvy £ Y (s + i^fn)e‘^\ 

n = -oo 

Finally, we obtain for t > 0 

oo 

Z e~ skT yikT + r) 

k = 0 

- pvf E 

n = -oo 

In the case r = 0 the left-hand side of Poisson’s formula is 

oo oo 

Z f( kT '> = Z »(kT)e- skT y(kT) 

k = — oo k = —oo 

*=1 

= -4 I+ E‘ r “ r *' 17 '> 



* = 0 



therefore, 



Z e- skT y(kT) = 
* = 0 



y(0+) 

2 



1 

+ pv — 



E >-(-4") 



. □ 



Let us apply the above formulas. Formula (2.8) can be written as 
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v +, ts\ 7(0+) 1 v' „( . 2n \ 

Y r (e Ts ) = — — + pv — ^ + 'yn] 

n = -oo 

where y(t) ° - ■ 7(5) and y(k T) °-o If we take for y(t) the unit-step function we obtain 




hence 



l-e~ Ts 

- I 1 1 
“ 1 + Y 



oTs 



e Ts - 1 



OO 

i IV s 

s + T 2-U s 2 + ,2»n) 2 ’ 



or, if we subtract 1 from both sides, 
1 



1 _ _J_ j_ J_ 2_ 

-i “ ~2 + Y 7 + Y / i 



s 2 + Of- n) 2 

The first of the last two formulas has an interesting interpretation if we formally take the 
inverse Laplace transform on both sides. We obtain a relation in the distributional sense: 



oo 1 1 2 °° 

y^S(t-nT) = — 6(f) + — u(t) +yYj “W 



2 nri 

cos — — — t , 



n = 0 



2nn 
cos t > . 



1 00 ( l 2 °° 

-6(t) +J^6(t-nT) = + T 

n = 1 V n= 1 

Replacing t by -t and adding the two equations gives 

oo 

Yj W-nT) 

n = -oo 

1 2 ^ 2 nn 1 A r Inn i 

= 7 + t L cos — t= T 2j exp i*^H 



2.1. 1.2 z-Transforms and MacLaurin Transforms 

Let f(k ) o-o F(z ) , | z I > p and assume that F{s) /s is a Laplace image function with the half- 
plane of convergence R 5 > jcq . Then 
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F(s) 

s 



Y m 

Zj vk+l 
k = 0 



by the definition of the z-transform. The range of s is restricted to the right half-plane 
Rs > max {p, xq] . Now 



Z /w 



k = 0 



s k + l 



oo 

-z 

/t = 0 



f(k)£\ 



(*) 



z»r 

* = 0 






= £[F(0] {s). 



We obtain the following proposition. 



Proposition. Let F(z) be the z-transform and F(t) the MacLaurin transform of the sequence 
f(k) . Then 



m = (0, F(z) = z £ [F«] (z). 



( 2 . 11 ) 



provided F(s)/s is a Laplace image function. 



This proposition can be used to compute MacLaurin transforms. For example: 



_L_ 

T\ 



o e l/z = F(z) 



F(s) _ e lls 
s s 



- /o[2V7]. 



Again we find that the MacLaurin transform of l/k\ is given by 7 q [2 VjT] . As a second 
example let us compute the MacLaurin transform of sin k to . We found earlier that 



sin oj k o — o 



= F(z) =* 



zsina) 

z 2 -2zcoso> + 1 
F(s) sin oj 

s s 2 - 2 s cos oj + 1 



sina> 



(5 - cos oj) 2 + 1 - cos 2 OJ 



■ - □ ^ sin[(sin oj) t ] . 

(5 - cos o>) + sin oj 



Therefore the MacLaurin transform of the sequence f(k) = sin oj k is given by 
F(z) = ^ cos<u sin[(sin of) z ] . 



The right formula of (2.11) can be used to find z-correspondences. But be careful! It only 
works if f(k) has a z-transform F(z)- Consider the following example. Let us start with the 
generating function for the Hermite polynomials which is known to be 



m = £ 



* = 0 



H k (x) k 

1 = 

k\ 



e 2 ,x ~? 
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By use of the correspondence 




s — 2x\ 

~2 y 



Thus the "z-transform of the sequence of Hermite polynomials" should be 
H k (x) o-o j exp[(y - x) ] erfc( j - x). 

But this is wrong! The sequence of Hermite polynomials is not z-transformable. The above 
image function is not holomorphic at oo. 

Problem 2.1. The z-transform of the Legendre polynomials P/t(x) is given by 

z 

Phi COS 0) o - o = 

V z 2 - 2 z cos 0+1 

where 0 is a parameter. Establish that the MacLaurin transform of Pk(x) is 

k = 0 



where Jo(x) is the Bessel function of order 0. 

Problem 2.2. A generalization of the MacLaurin transform of a sequence f(k, a) depending 
on a parameter a is defined by 



P(z, or) := 



y /(*, a) 

£j Q T(k + a+l) 



Show that if /(&, a) has the z-transform F(z, a ), then 
F(z,a)= 

provided that F(s, a) / s a+l is a Laplace image function. 



Problem 2.3. The z-transform of the generalized Laguerre polynomials Lf\x) is given by 






(for a = 0 this is the ordinary Laguerre polynomial). Use Problem 2.2 to establish the 
generalized MacLaurin transform of l}^\x), i.e., 



Hz, a) := 



z 

t = n 



Lf(x) 

r(£ + ar+l) 



Z* = (xz) a/2 e z J a (2 y/lxz) 
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where J a (x) is the Bessel function of order a. Also see the example in Section 2. 1.2.5. 



■ 2.1.2 Operational Properties 



2.1.2.1 Linearity 

The defining series of a z-transform implies that a z-transformation is a linear operator. The z- 
image of a linear combination of original sequences is the linear combination of the 
corresponding images: 

Z[C! Mk) + c 2 f 2 (k)] (*) = C\ Z\f\ (k)l (k) + c 2 Z[f 2 m (k) . (2.12) 

2.1.2.2 Original Shift Properties 

There are two shift properties relative to the independent discrete variable, similar to those of 
the Laplace transformation of Section 1.1. 2.5. The right shift property is: 

Proposition. Let m be a positive fixed integer and let f(k) ° - o F(z ) . For the original 
sequence shifted m units to the right, i.e. u(k - m) f{k -m), we then have 

u(k - m) f(k -m) o-o z~ m F(z ) . (2. 13) 



Proof 



u(k - m) f(k -m) ° - o ^ f(k -m)z k 

k-m 



= J]mz- (k+m) = z~ m YjAVz-* = z~ m F{z) . □ 
k = o k=0 

The left shift property is more important. If an original sequence is shifted m units to the left, 
the values over the negative discrete axis are replaced by zero. Thus the new original is 
u(k) f(k + m) . As for the Laplace transformation, see Section 1.1.1, the discrete unit-step u(k) 
is omitted. The rule for a fixed positive integer m is: 

Proposition. Let m be a positive fixed integer and let f(k) ° - o F(z ) . For the original 
sequence shifted m units to the left, we then have 



m - 1 

f(k + m) °-o f F(f) - , (2.14) 

k=0 

f(k+l)o-o z F(f) - f(0)z, 

f(k + 2) o-o ZF{f) - f(fl)z 2 - f(l)z, 

f(k + 3) o-o z 3 F(f) - /( 0) z 3 - /( 1) z 2 - /(2) z , 



This rule is similar to the differentiation rule of the Laplace transformation and it is used to 
solve forward difference equations. 
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Proof. 



f(k + m) o-o 2 /(* + »*)*■* = Y J f(k)z- (k - m) = f Yjf(k)z- k 

k= 0 k=nt k-m 

{ oo m-1 A m-1 

£/(*)*■*- 2 /(*)*"' 1 } = - Yu f{k)fl ~ k • D 

fc=0 *=o J *=o 



2.1.2.3 The Image Scale Change or Damping Rule 
Proposition. Let at 0 be any complex number , then 

f(k) ° - o F(z) =* a k f(k ) ° - o F(a z) . 

Proof 

oo oo 

a~ k f(k) °-o J]a- k mz- k = ^ /(&)(az)~* = F(az). □ 

k=0 k=0 

This rule implies 

e~ kX f(k) ° - o F(e x z) , 

/(A:) o-o F(^' w z) , /(*) o-o F(e~ ia) z ) , 

coskco f(k)°-o {F(e~ l0) z) + FV^z)} , 

sin k to fik) o-o — { F{e~ l0} z) - F{e ia) z)} . 

2.1.2.4 Multiplication and Image Differentiation Rules 
Proposition. If f(k) °-o F(z ) , then 

dF 

kf(k) o-o -z — • 



Proof 



kfik) o-o^kf(k)z k = -z^T J f(k)(-k)z k 1 



*=0 



k=0 






k = 0 ^ k = 0 

Applying this rule repeatedly, we obtain for a fixed positive integer m. 



d m 

fik) ° - o F(z) => *" /(*) ) F(z) . 



(2.15) 



(2.16) 



For example, 
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d 2 

k 2 f(k ) o-o (-Z — ) F(z) 

= z{F' ( z) + zF"(z )} = zF' (z) + z 2 F"(z) . 

Starting from the definition of the z-transform, we obtain by successive differentiation, 

CO 

f'{z) = 

*=0 

oo oo 

= 2 (- 1) /(*) * z~ ( * +l) = 2 ( ~ l) f(k - 1} ( * - z ~* ’ 

*=1 k=2 

CO 

F"(z) = £(-!>/(*- 1)(* - 1) 

k-2 

oo 

= %(-!? f(k-W-l)kz-^ 

k=2 

oo 

= Z (_ 1)2 f{k -2)(k-2){k-l)z- k 

k = 3 

oo 

= Yj (- 1 ) 2 «(* - 3) /(* - 2) (* - 2) (* - 1 ) z” 4 

k= 0 

o-o (-1) 2 u(k - 3)/(&- 2) (k -2)(k- 1). 

This yields the image differentiation rule. 

Proposition. Ifm is a positive integer and F(z) o - ° f(k ) , then 

F< m \ z ) o - ° (- l) m uik - 1 - m) (it - 1) (k - 2) • • -(it - m) /(*: - m). 



Examples. 



d 


z 


z 


dz 


z- 1 


(Z-1) 2 ’ 


d 


z 


z(z + 1) 


dz 


(z-1) 2 


~ (z-1) 3 ’ 


d 


z(z + 1) 


z(z 2 +4 z + 1) 


dz 


(Z-1) 3 


(Z-1) 4 



The first original shift rule applied to z / (z - a) o - ° a k yields 



F(z) = 



o-o„(jt-l) a k ~ l . 

( z-a ) 



(2.17) 



Differentiating m times and using the above image differentiation rule induces 
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WmW (-1 ) m tn\ 

(z-a) m+l 

o - ° (- l) m ( k - 1) (it - 2) ... (it - m) u(k - 1 - m ) a*- 1 -”. 

The second original shift rule gives 

— Z m ' o — o fc (& - 1) • • •(£ - m + 1) u(k - m) <J c ~ m 

(z - a) 1 

and finally, by linearity 

z k(k-l)---(k-m+l) k 

-r o - o u(k -m)cr 

(z - a) 1 ml 

= u(k-rn)fya k - m . 

Replacing m by m - 1 yields the important correspondence, valid for m = 1, 2, . . . , 
z .. t k \ ( k 



L-iK 



-m+1 



fe “ <* ) 

which is the inverse z-transform of a partial fraction. 

The Pochhammer Symbol is defined by 
f v . = f m = 0 

l a (a + l)(<z + 2) . . .(a + m - 1), meN. 

Let us find the z-transform of (k ) m , where m is a nonnegative fixed integer. We have 

(*) 0=1 o-O 



z — 1 
z 






2z* 



(k) 2 = k(k+ 1) = h? +k o-o + ^ + — y = 7— 

(z-1) 3 (z - 1) 2 (z-1) 3 



similarly. 



(*) 3 



bz 3 



(z-1) 4 

Obviously, we have for m = 1,2, 3, 
/n!z m 

m ° ° (z-l) m+1 ’ 



(2.18) 



Let us prove this by an induction on m . The step from m to m + 1 is 




z-T ransformation 



93 



(k) m+l = (k) m (k + m) = k (k) m + m {k)„ 



d 

o—O —7 

dz 



mlz™ 



(z-iy 



m+l 



+ m ■ 



m'.zT 



(z-iy 



,m+l 



(m + 1)! z m+1 (/m + 1)!^ 1 



(z-iy 



,m+2 



(z- iy 



(m+l)+l * 



We can include the case m = 0 by writing 

m! z" 1 



u(k-l)(k) m °-o 

(k)m 

u(Jk — 1) ——J— o — < 



fe-D m+1 

z" 1 

\m + 1 



(m = 0, 1, 2, ...), 

(m = 0, 1, 2, ...)• 



(z-ir 

By replacing A: by k + 1 and using the second original shift property, we obtain 



(k+l) 



r^ 0-0 (i^r) m+1 < m=0 - 1’ 2 > 



The image scale change property yields 
(Jc + l) w / 7 



0>lf2j } 

m! \z-a / 



(2.19) 

( 2 . 20 ) 



( 2 . 21 ) 



( 2 . 22 ) 



2.1.2.5 The Image Shift Property 



If F(z) o - o /(&), | z | > p, what can be said about F(z - a) o - o #(£)? First of all, the circle 

of convergence of F(z - a) is given by | z I = | a | + p, i.e. F(z - a) will be a holomorphic 

function outside the circle of radius | a | + p. The reason is that 

I z I > M+p ==» Ul- M >p, 

but | z | - \a \ < | | z I - \a \ \ < | z - | and | z I > | a | + p implies | z - I > p. Now 



F(z - a) = ^ /(A:) (z - a) * , 

k = o 



(z - a)~ k 




1 , * = 0 



ke N, 



therefore, 
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F(z-a) =/(0) + 



&»s* 



d z <k+n) 



/=i *=i 

=m + f,j]m( f ~_ 1 k )a f - k z- t . 

f=i k=i 

We have proved the following rule: 

Proposition. If F(z) o - ° f(k) for \ z I > p, 

k 



F(z - a) o-o g(k) = m 8(k) + Yj m ()_ J) . * > 0 

1 = 1 

for |z| > \a | + p. The symbol 8(k - m) := 8 km is the Kronecker symbol. 

Example. Assume that the z-transform of the Laguerre polynomial L k (x) is 

(iffM-pr)- 

Let us find L k (x). The inverse z-transform of exp (-x/z) is the sequence (~x) k /Jd. The first 
original shift property implies 



(2.23) 



A*-l 



exp(-x/z) /f (-x) 

— ; — -■‘‘-"FI n‘ fm ' 

The above image shift property yields 
exp(-*/(z- 1)) 



z- 1 



o-° g(k) 



E (-jc) /_1 (k-l\ 

1 = 1 

E k ~ l (~x)‘ /jfc-l\ 

V-( i )■ 

i = 0 

The second original shift property implies 

(iffW-irr) 0 - 0 ^ ^(i) = Lkix) • 

i = 0 
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2.1.2.6 The Division Rule 

Let f(k) be a sequence with /( 0) = 0 and with z-transform F(z ) . What is the z-transform of 
f(k)/k ? For any z -image F(z) we can write 



f- 



(g)dt = Y(,oo)-Y(z) = y(0) - F(z) , 



provided z is outside the circle of convergence of Y(z ) . Let y(k):= f(k)/k for k>0 and 
y(0) := 0, then f(k) = k y(k) . Hence 



f(k) o-o -z r (z) = F(z) =» r (z) = - 



F(z) 



By the reasoning above 

Y(z) = y(0) - £°° r © rff = jT dl 

We have proved the following rule: 

Proposition. If f(k) ° — o F(z) and f(0 ) = 0, then 

m p Hfi 

Example. f(k) = u(k - l)a k . We have 
/(A:) = u{k- \)a k o-o 



z-a 



r — < 

T , 



■MW-Ht)’ 



finally. 



«(£- 1) -7- °-o ln( — - — ) , u(k- 1) -j- 0-0 ln( — . 
& \z-a ' k v z — 1 / 

Problem 2.4. Apply again the above proposition and find 



(2.24) 



u(k 



X ? Hi)) "(fTT)^ 
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2.1.2.7 Convolution of Sequences 

Let f(k) and g(k) be two original sequences. 

Definition. The convolution ( f*g ) (k) of the two sequences is the original sequence defined by 

k 

■= J]f(k-i)8(i). (2.25) 

1 = 0 

Remark. For (f*g) ( k ) we also write f(k) * g(k ) . 

Because of 




the convolution product is commutative, i.e f*g = g*f. The convolution is also distributive, 
i.e. f*(g + h) = f*g + f*h. This follows immediately from the definition. The convolution 
of three originals is defined by 

if *g*h)(k) := Yj f(k-i~j)g(i)h(j). 

0< i+ j <k 



The convolution product is associative, i.e. f*(g*h)= (f*g)*h, because 
(f *g*h)(k) := Y f(k-i-i)g(i)h(j) 

0< i + j <k 



= Y E f(k-i-fgi)h(j) = YTj f(k - ()8(f - j)h(j) 

t = 0 i+7' = / /= 0 7=0 

k ( k 

= y f(k -f)Y 8(( - ^ = Y fik ~ ()(g * h) <e) = (f*(g*h))(k). 

^0 j = 0 



This shows that /* g * h = f*(g*h). Similarly, f*g*h = (f*g)*h. 



We now prove the convolution theorem which is similar to the convolution theorem of Laplace 
transformation. We start with the product of two z-images: 



F{z)G{z) = 





g(.f)Z~ e 



co oo o on oo 

= YTj f(k)g(()z ~ (M> = X Z /(n ~ () g{() z ~ n = 'Z (f * 8) (n) z ~ n ■ 

k = 0 /= 0 n=0 /= 0 n = 0 



We have established the 



Convolution Theorem. If f{k) °-o F(z) and g(k) °-o G(z), then 
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(f*g)(k)o-oF(z)G(z). (2.26) 

The ordinary product of two z-image functions corresponds to the convolution product of two 
original sequences. 

By taking f(k ) = u(k) = 1 , we obtain 

k 

(u*g)(k) = £lg(0 o-« -i- -G(z). 

1 = 0 z 1 

This is the Summation Rule. If f(k) o F(z) then 

k 

s(k) := V f(i) o - o S(z) = F(z) . (2.27) 

tri z-1 



Example. 



k 

cZ* ct = Yj a k ~‘ a' 
1 = 0 

(k + 1) a k * a k 

k 

= + 1 )a l 

i = 0 



fll E 1 = (*+D«*°-o(Tr^) 

i = 0 4 



A* X ^ +l ) = ak 



(k+ l)(* + 2) 



i = 0 



Therefore 



* (^+l)(ifc + 2) / z ^ 

cr °-o . 

2 \z-af 

By induction, we again find the correspondence 

(k+\)(k + 2)...{k + m) ^ (A: + \) m _ ^ ,k + m\ / z \ m+1 



Example. From the example at the end of Section 2. 1.2.6 we immediately obtain the z- 
transform of the partial sums of the harmonic series: 




2.1.2.8 The Product Rule and Parseval’s Relation 



Let f(k) o-o F(z) for | z \ > r\ and g{k) ° - o G(z) for | z I > r 2 . We form the product 



F<p)G (p)^ 



oo / oo . 

fc=0 J \f= 0 y 



’ 



where p is assumed to be on the circle | p | = r with r x <r <\z \ / . This implies that 

| z I >r x r 2 and |z/p| > r^/r =r 2 , hence 
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f+l+k 



t=0k=0 



Now we take the line integral along the circle | p | = r in the positive sense 

— fF(p)G (— ) — dp = V y\f{k)g{f)z~ ( -2-r f — ^u* d P> 

2m J c \p> p fToj^o 2m J c p f+1+k 

where we interchanged integration and summation. For the integral on the right-hand side we 
have 

i r i . (i, f = k 

2 ni J c p~ f+l+k P vO, f±k 



which implies 






We have proved the following product rule: 

Proposition. Let f(k) o F(z) for \z \ > n and g(k) o G(z) for \ z I > r 2 , then 



/(«*<*)-<. h(z) = ^ JS£Lc{j)i l , 



(2.28) 



where the image function H(z) is defined for \ z \ > rj r 2 , and the line integral is taken along 
the circle \p \ = r in the positive sense with ri < r < | z I I r 2 . 

Example. From 

u(k-\) L °-o -L- f — ln( — ] ln( ~ P -] dp, 
k 2 2m J c p vp- 1/ \ z /p- 1> y 

where C is the circle centered at the origin and with radius r , 1 < r < \ z I . Finally 

ti(k- l)L °-o -i- S' llnf—E—) i n {—L-)j p 
k 2 2ni J c p \p-\t V z - p f 

which gives the image function as a line integral. 

Now assume that all singularities of F(z) are strictly inside the unit circle. Taking r\ = 1 in 
(2.28) and \z \ > 1 , we obtain 






(2.29) 



which is called Parse val’s Theorem. 



If in the relation 
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the limit for z -> 1 taken from the outside of the unit-circle exists, we obtain 



2 um 2 

k = 0 




which may be used to compute the energy of a discrete signal. 
From the example above we obtain 



Indeed the line integral can be computed along the contour in Fig.2.2. 



(2.30) 




By Cauchy’s integral theorem the line integral along this contour is zero since the integrand is 
holomorphic inside the contour. On the small semi-circle around the origin the line integral 
tends to zero if the radius shrinks to zero. On the upper side of the segment [0, 1] the integrand 
is 






and on the lower side it is 



+ ''l ln (rb)' 



Therefore we have 



= X T ,n (-nb)‘'” = 
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2.1.2.9 The z-Transform of a Periodic Sequence 

Definition. An original sequence f(k) is periodic with the integer period N, if f(k + N) = f{k ) 
for all nonnegative integer k. 

For the z-transform of f(k) we then have 

oo oo N— 1 

/(*) = f(k + N) o-o £/(*)*"* = ZZ /( * + fN)z- (k+m 

k= 0 t=0k=0 



oo N- 1 oo N- 1 , N- 1 

= = E fir 

/ = 0)t = 0 / = 0 * = 0 4 * = 0 

We have proved: 

Proposition. The z-transform of the periodic sequence f(k) with period N is given by 



f(k) = f(k + N)o-o 



7? 

Z N ~ 1 



N - 1 






(2.31) 



The right-hand member can be written in the form 

zP(z) 
z N - 1 

where P(z) is a polynomial of degree N- 1 . This shows that the z-image of a periodic 
sequence is a rational function with at most N distinct simple poles which are AMh unit-roots 
of 1. 



2.1.2.10 The Initial and Final Value Theorems 

Initial Value Theorem. If /(l)°-o F(z ) , then /( 0) = lim^oo F(z). 

This follows immediately from the definition of the z-transform. Assume now that 
lim f(h) = : a exists. We can write for any finite n, 

n-*o o 

n n 

f(n + 1) - /(0) = Z/(*+D- /(*) = lim E [/<* +D- /(*)] z'*- 

k = 0 Z ^ 1 k = 0 

By letting n -> oo and by the assumed fact that the limit on the left-hand side exists, we obtain 



oo 




On the right-hand side is the z-transform of the sequence f(k + 1) - f(k) which is 
zF(z)-zf( 0) - F(z) = (z-l)F(z) - /(0). 



Hence, we obtained the 
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Final Value Theorem. If lim f(n) exists it can be computed by lim z _>i (z - 1) F(z ) . 

n-> oo 

Example. Let us test some established rules. We start with 
due to the second original shift rule. By the k-multiplication rule 

‘itt Witt)} 



Thus, 



= - limz (z - 1) Inf Z | + lim z = 0+1 = 1 
z-»l V Z - z-+ 1 

which equals lim n / (n + 1) . 

n-» oo 

Problem 2.5. Establish the following correspondences 
(7)i (. a\-y i z \y 



«*©-* (* * ff - ■ izi>i »'- 



Problem 2.6. Use Problem 2.3 to establish the following relation between the Laguerre 
polynomials L k (x ) and the generalized Laguerre polynomials L^\x) : 

k (or), 



Lf\x)= Yj ~{ f L *-'W- 



/ = 0 



■ 2.1.3 The Inverse z-T ransformation 

2.1.3.1 Inversion Formulas 

In Section 2.1.1 we introduced the following 

Inversion formula. If F(z) for | z I > p is a given z-image function, the inverse z-transform of 
F(z) is obtained by 
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m = -2— fF(z)z k ~ 1 dz (k = 0,l,2, ... ), (2.32) 

27 XI Jc 

where the line integral is taken in the positive sense along a simple closed path C, which 
encircles the origin and lies completely inside the domain \z\ > p, where F(z) is a 
holomorphic function. 

If the singularities on or inside the circle of convergence | z I = p are all isolated, i.e. there are 
no branch points, the line integral can be evaluated by the computation of residues. 

Example. 



F(z ) = 



z(z - c) 



(z - a) (z-b)’ 

f(b\ - _L_ f J _ p ( Z* (z - c) \ 

2 ni Jc (z - a) ( z-b ) Z £b { (z - a) (z - b) / 

cf (a- c) . b k (b-c) 1 r/ , k „ 

= —+ — = -[(a-c)ct - ( b-c)b k ]. 

a- b b-a a-b 

Another inversion formula, which stems from Taylor’s theorem of power series, is 



(2.33) 



Example. 



F(z) = arctan — , 
z 

_/ 1 \ 1 o 1 < 

F — = arctan z = z - — z + —z - + • • • 
V z ' 3 5 



thus 



m = 



i-(-D* (-i 
2 k 



(k = 0 , 1 , 2 , ...). 



2.1.3.2 The Inverse of Rational Image Functions 

If the z-image F(z) of a sequence f{k) with /( 0) ^ 0 is a rational function, the degree of the 
numerator polynomial equals the degree of the denominator polynomial. Only if /( 0) = 0 is 
the image a proper rational function. Thus, if F(z) is a rational z-image, we have two cases: 

1. F(z) is a proper rational function. 

2. F(z)/z is a proper rational function. 

Furthermore, most rational image functions encountered in applications are real, i.e. a quotient 
of two polynomials with real coefficients. Such an image satisfies F(z) = F(z). As we did for 
Laplace rational image functions, we assume in the following that the z-image functions are 
real rational functions. We now refer to Section 1.1. 4.1. If we assume that the denominator 
polynomial P(s) is completely factored out, the partial fraction decomposition of F(z) in the 
first case is given by 
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F(z) = 



Q(z) 

P(z) 



= Q(z)/(z-f i) Vl ...(z-£,) v ' Hz - at) (z - aY)] M ‘ .. 



V^T 



UirtF 

k=l 






^kvi 



(z-fj 



,v*-l 



(z-&). 



[(z-acMz-arc)]^ 



+ 




0kl 

(z - 



+ 



_5d_\ 
(z-af) v * / 



+ 



( a kv ! + ^kvt 

vfe-ar*) 



where £ v are all distinct real zeros and (a u ,a^) are the pairs of all distinct nonreal zeros of 
P(z). In the second case the left-hand side must be replaced by F(z)/z- We see that the inverse 
z-transform of a rational image function can be computed if we know the inverse z-transforms 
of the following partial fractions: 

1. 

1 a a 

(z - £) v ’ (z-a) v + ( z-af 



for the first case, and 

2. 



az az 

+ 



(z - £) v ’ (z-a) v (z-a) v 

for the second case. From (2. 18) we have for a real or a nonreal zero a 



z t k 

o 



(z - a) v 



(v-iH~ v+1 ’ < v=i ’ 2 ->’ 



or explicitly, 



— — o - o a k , — - — — o - ° k a k 



z-a 

z 

(z - a) 3 



(z-a) 

k(k-\) k _ 2 z k(k-l)(k-2) k _ 3 

o_o a z o-o a * 



(z-aY 



3! 



(2.34) 



etc. 

The first original shift property then implies 

o~°u(k~ 1) (* “ |) o*- v , (v = 1, 2 ...), (2.35) 



or explicitly 
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>-o u(k- \)a k l , 
o-o u{k- \){k- 1) a k ~ 2 , 



z-a 
1 

(z - a) 2 

1 /f lx (k-l)(k-2) k _ 3 

7- o - o u(k - 1) a J 

(Z-a) 3 2 



1 



o — o u(k— 1) 



(*-l)(ifc-2)(*-3) 



(z-a) 4 3! 

etc. Thus, if a = £ is real, we have what we need. For the pair 



az az 

+ ■ 



(z-a) v ' (z-af 
with a nonreal a = \ a \ e iy and a = | a | e l * we obtain 



az az 

■ + 



C z-a) Vk (z-aY 

k 



v k—v+l 



o-o \a\ e llp ^ \a\e iy ) k 

+ \a\ e~ l(p ^ ^ ^j( | a \ e~ iy ) k V+1 
= i a i ( | a | )*" v+1 ( k ) { e ilv(k-v+i)+ v ] + e -i [r(t-v+i)+«>] } 
= 2 i a i ( | a | )*~ v+1 1 * j cos[y (& - v + 1) + y>] . 



Finally, 



az az 

+ 



(z - aY k ' (z - aY 
o-o 2 i a i ( | a | )* -v+1 ^ j J cos[y (k - v + 1) + ip ] , 

and similarly, 



a a 

• + 



(z - aY k (z - aY 
o-o 2 u(k-l) \a \ ( | or | )* -v ^ j j cos[y (& - v) + ip \ . 



Example. 



F(z) = 



z{z + 1) (z 2 + 2) 
(z-2f(z 2 +2z + 2)' 



(2.36) 



(2.37) 



The partial fraction decomposition yields 
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F(z) (z+l)(z 2 +2) 

z (z - 2) 2 (z 2 + 2 z + 2) 

9 1 18 1 / 7 i \ 1 / 7 i \ 1 

5 (z-2) 2 + 25 z - 2 '50 50 / z — (- 1 + 0 + ' 50 + 50 ' z - (- 1 - i) ’ 



therefore 



F(z) = 

9 z 



18 z /I i \ z / 7 

+ 25 z-2 + 1 50 " 50 ' z - (- 1 + 0 + ' 50 + 



5 (z-2) 2 
1_ J_ _ 
50 + 50 



V50 



e K ‘ , ‘ > , -1 + i - yp2 e 



A arctan(l/7) 



z-(-l + 0 

,i 3 n/4 



-L) z - 

50 / z-(-l-i)’ 



f(k) = jk 2 k 1 + -^-2* + -^==- (V^)* cosj-^- k + arctan yj . 



Problem 2.7. Show that we also can write, with a = | or | e iy and a = A + B i : 



az az 

(z-ct) n + C z-a) v 

o - o 2 ( | a | )* -v+1 ( y ^ cos[y (k - v + 1)] - B sin[y (k - v + 1)] } , 



a a 

(z-a) Vk + (z-a) v 

o-o 2 u(k-\) ( | or | /~ v ” j) {A cos[y (k -v)]- B sin[y (k - v)] } . 



2.2 Difference Equations 



■ 2.2.1 Difference Equations of Order n 

A linear forward difference equation of order n with constant coefficients is a relation of the 
type 



y{k + n) + c n - 1 y(k + n- 1) + • • • + c\ y(k + 1) + Co y{k) = f(k). (2.38) 

If the first n initial values are given, i.e., 



y(0) = y 0 , y(l) = yu .... yin- 1) = i, (2.39) 

then (2.38) with k = 0 enables one to compute yin). By applying again (2.38), now with k = 1 , 
y(n + 1) is computed and so on. The two relations (2.38) and (2.39) constitute an initial value 
problem and we just saw that it has a unique solution. It is easy to compute recursively the 
sequence y(k) or the first few k’ s, but our aim is to obtain a closed expression for the unknown 
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sequence y(k). In order to achieve this, we assume that the unknown sequence has a z- 
transform, i.e y{k) ° - o Y(z). By the second original shift rule we have 

y(k+ 1) ° — o z Y(z)-zyo , 

y(k + 2) o-o z 2 Y(z) - z 2 yo-zyi , 

y(k + n) °-o z" T(z)~ z n yo~z"~ 1 yi z 2 y n -i - zy n - 1 • 

If we also assume that f(k) °-o F(z), we obtain, by use of the linearity rule, the image 
equation 



(z" + c^iz"- 1 + •••+ Ciz + c 0 )Y(z ) 

-y 0 (z"+ c„_i z" _I + ••• + ci z) -yi(z" _1 + c„_i z"“ 2 + ••• + c 2 z) 
y n - 2 (z 2 + c„_ i z) - y„_i z = F(z) . 

To (2.38) we associate the characteristic polynomial 



P(z) = z" + c„_! z" 1 + ••• + Cl Z + C 0 . (2.40) 

The z-transform of the global solution of the initial value problem can then be expressed as 
F(z) t + c„_i z" -1 + ••• + ci z 

r<!> -w + y ° m 



+ yi 



z” 1 + C„-1 z" 2 + ■■■ + C 2 Z 
P(s) 



(2.41) 



Z + C„_1 Z z 

+ + yn ~ 2 p(zj + y 

Again we call 

««> 



(2.42) 



the forced response of the discrete system, modeled by the difference equation, and 



yo(k) := 

yo z _1 

+ yiZ-‘ 



z" + C„_1 z" 1 + ••• + Cl Z 



P(z) 

z" _1 + C„_1 z" -2 + ••• + C2 Z 



(k) 

lw 



+ y n - 2 z 1 



z 2 + C n -iZ 
P(Z) 



(k) 



+ ^n- 




(2.43) 



is said to be its free response. 

In the difference equation (2.38) we often have another difference operator that is acting on the 
input sequence. The difference equation is then 




z-T ransformation 
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y(k + rt) + c n -i y(k + n — 1) + ••• + c\ yik + 1) + c 0 y(k) ... 

= bof(k) + *,/(*+l) +••• + b m f(k + m). ' J 

By proceeding as above, we can now write 

yi(k) := Z-*[G(z)](*) (2.45) 

for the forced response, where 



G(s) = 



b 0 + bj z + ••• + b m f 

P(z) 



(2.46) 



is called the transfer function of the discrete system. The expression (2.43) for the free 
response has to be replaced in this more general case by 



yoW := yo z 1 



z" + C„-i z" 1 + ■■■ + C\Z 



+ yi 7T 
+ ... 

+ y„-i z _1 



P(Z) 

Z" _1 + c„- 1 z"“ 2 + ••• + c 2 z 



(k) 



P(z) 

C„_iZ 



(£) 






Piz) 

bmZ m + b m . 1 z m - 1 + - +b lZ 



-/(O)Z- 1 

-/(l)Z- 1 



F(z) 

fcm z " 1-1 + b m - 1 z " 1-2 + ••• + b 2 z 



(k) 



P(z) 



C k ) 



-f(m-2)Z~ 



b m z + b m - 1 z 



f(z) 



(*) 



Example. y(* + 2) - 7y()fc+l) + 10y(fc) = 16ifc;y(0) = 6, y(l) = 2, 

P(z) = z 2 -7z + 10 = (z - 5) (z - 2), 

F(z) = 16z /(z- 

16 z z 2 -7z ^ z 

2 “ (z-1) 2 (z-5)(z- 2) + (z - 5) (z - 2) + 2 (z-5)(z-2) 
_ 2 z ( 3 z 3 - 26 z 2 + 43 z -12) 

(z-1) 2 (z-5)(z-2) 



The decomposition in partial fractions yields 




